-- Logs begin at Mon 2022-05-16 19:39:44 UTC, end at Mon 2022-05-16 20:55:02 UTC. -- May 16 20:27:54.187047 dv-cinder-777031-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 16 20:27:54.194538 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 16 20:27:54.198673 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 20:27:54 2022] *** May 16 20:27:54.198673 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 20:27:54.198673 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 20:27:54.198673 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: nodename: dv-cinder-777031-16-iscsi May 16 20:27:54.198673 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: machine: x86_64 May 16 20:27:54.198673 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: clock source: unix May 16 20:27:54.198673 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: pcre jit disabled May 16 20:27:54.198673 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: detected number of CPU cores: 4 May 16 20:27:54.198673 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: current working directory: / May 16 20:27:54.198673 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: detected binary path: /usr/bin/uwsgi-core May 16 20:27:54.198673 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: your processes number limit is 47680 May 16 20:27:54.198673 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: your memory page size is 4096 bytes May 16 20:27:54.198673 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: detected max file descriptor number: 2048 May 16 20:27:54.198673 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: lock engine: pthread robust mutexes May 16 20:27:54.198673 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: thunder lock: enabled May 16 20:27:54.198673 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 16 20:27:54.198673 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 20:27:54.242190 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: Python main interpreter initialized at 0x55fccf62a9c0 May 16 20:27:54.242190 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: python threads support enabled May 16 20:27:54.242190 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: your server socket listen backlog is limited to 100 connections May 16 20:27:54.242190 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: your mercy for graceful operations on workers is 90 seconds May 16 20:27:54.242543 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: mapped 403077 bytes (393 KB) for 2 cores May 16 20:27:54.242628 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: *** Operational MODE: preforking *** May 16 20:27:54.242880 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: *** uWSGI is running in multiple interpreter mode *** May 16 20:27:54.242880 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: spawned uWSGI master process (pid: 102755) May 16 20:27:54.243090 dv-cinder-777031-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 16 20:27:54.244380 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: spawned uWSGI worker 1 (pid: 102756, cores: 1) May 16 20:27:54.244380 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: spawned uWSGI worker 2 (pid: 102757, cores: 1) May 16 20:27:54.244380 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 20:27:55.409952 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 20:27:55.418876 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 20:27:56.152706 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 20:27:56.152706 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: from cryptography.utils import int_from_bytes May 16 20:27:56.152998 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 20:27:56.152998 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: from cryptography.utils import int_from_bytes May 16 20:27:56.159101 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 20:27:56.159101 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: from cryptography.utils import int_from_bytes May 16 20:27:56.159429 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 20:27:56.159429 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: from cryptography.utils import int_from_bytes May 16 20:27:58.758149 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 20:27:58.758870 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 20:27:58.758870 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 20:27:58.759236 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 20:27:58.759509 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 20:27:58.759889 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.760211 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.760563 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.760879 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.761207 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.761515 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.761832 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.762138 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.762452 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.762709 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.763030 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.763377 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-777031-16-iscsi {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.763668 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.763967 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.764258 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.764592 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.764902 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.765212 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.765309 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 20:27:58.765696 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.765789 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 20:27:58.765988 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.766116 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 20:27:58.767179 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 20:27:58.767287 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.767366 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 20:27:58.767441 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.767441 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.767590 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.767666 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.767739 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.767813 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.767891 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.767969 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.768043 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.768241 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.768326 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.768555 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.768671 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.768882 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.769012 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.769177 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.769269 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.769559 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.769661 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-777031-16-iscsi {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.769820 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.769915 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.770138 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.770235 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.770468 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-777031-16-iscsi {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.770557 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.770795 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.770896 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.771106 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.771257 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.771421 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.771517 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.771740 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.771837 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.772047 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.772143 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.772351 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.772482 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.772697 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.772792 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.773010 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.773204 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.773347 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.773703 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.773809 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.774022 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.774111 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.774337 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.774425 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.774642 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.774739 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.774953 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.775055 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.775254 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.775367 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.775556 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.775646 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.775802 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.775889 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.776103 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.776202 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.776419 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.776548 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.776756 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.776900 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-777031-16-iscsi {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.777073 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.777218 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.777306 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.777546 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.777645 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.777837 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.777929 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.778152 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.778247 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.778459 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.778557 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.778763 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.778862 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.779065 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.779153 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.779369 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.779465 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.779670 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.779763 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.779979 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.780073 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.780280 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.780385 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.780610 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.780708 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.780927 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.781014 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.781237 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.781337 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.781553 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.781647 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.781860 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.781948 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.782180 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.782288 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.782488 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.782578 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.782794 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.782881 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.783045 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.783140 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.783356 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.783461 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.783675 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.783770 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.783995 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.784088 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.784307 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.784394 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.784582 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.784686 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.784835 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.784925 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.785155 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.785249 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.785475 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.785570 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.785786 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.785873 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.786095 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.786188 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.786391 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.786489 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.786635 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.786737 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.786929 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.787022 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.787228 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.787325 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.787541 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.787635 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.787841 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.787975 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.788150 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.788241 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.788465 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.788570 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.788758 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.788846 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.789059 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.789147 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.789429 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.789518 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.789737 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.789878 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.790040 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.790135 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.790342 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.790431 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.790641 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.790757 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.790942 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.791078 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.791238 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.791388 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.791535 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.791707 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.791847 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.792030 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.792159 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.792339 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.792481 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.792676 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.792772 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.792987 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.793089 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.793307 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.793419 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.793637 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.793734 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.793934 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.794028 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.794184 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.794278 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.794486 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.794574 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.794793 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.794887 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.795106 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.795208 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.795412 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.795506 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.795711 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.795796 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.796012 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.796100 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.796314 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.796409 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.796631 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.796720 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.796935 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.797039 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.797245 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.797344 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.797546 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.797640 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.797847 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.797949 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.798145 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.798239 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.798441 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.798535 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.798737 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.798834 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.799035 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.799130 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.799330 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.799418 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.799625 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.799720 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.799924 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.800011 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.800233 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.800329 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.800562 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.800665 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.800864 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.800952 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.801167 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.801261 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.801465 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.801564 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.801771 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.801856 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.802093 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.802188 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.802399 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.802495 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.802706 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.802802 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.803025 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.803118 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.803334 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.803423 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.803643 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.803732 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.803963 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.804056 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.804262 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.804350 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.804591 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.804679 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.804939 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.805028 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.805248 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.805337 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.805556 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.805640 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.805860 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.805960 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.806161 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.806255 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.806465 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.806559 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.806775 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.806874 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.807077 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.807165 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.807381 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.807479 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.807682 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.807778 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.807985 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.808077 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.808297 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.808385 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.808637 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.808733 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.808945 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.809029 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.809250 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.809337 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.809571 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:27:58.809659 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.809907 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.809994 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.810214 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.810302 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.810534 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.810635 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.810854 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.810952 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.811195 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.811528 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.811848 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.811951 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.812176 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.812285 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.812515 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.812611 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.812846 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.812939 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.813159 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.813251 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.813598 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.813711 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.813798 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.813871 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.814097 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.814186 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.814405 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.814492 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.814718 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.814812 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.815033 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.815127 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.815349 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.815461 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.815662 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.815751 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.815972 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.816067 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.816285 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.816387 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.816691 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.816853 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.817010 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.817158 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.817300 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.817443 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.817609 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.817751 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.817964 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.818112 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.818264 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.818406 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.818586 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.818725 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.818889 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.819027 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.819240 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.819393 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.819486 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.819581 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.819839 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.819972 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.820161 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.820295 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.820498 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.820618 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.820836 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.820943 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.821147 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.821244 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.821459 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.821555 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.821767 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.821871 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.822075 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.822172 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.822379 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.822469 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.822687 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.822782 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.822993 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.823083 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.823299 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.823390 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.823620 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.823718 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.823930 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.824020 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.824237 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.824347 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.824575 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.824688 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.824881 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.824978 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.825183 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.825281 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.825490 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.825590 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.825797 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.825886 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.826103 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.826190 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.826413 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.826511 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.826719 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.826817 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.827038 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.827128 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.827352 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.827443 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.827662 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.827749 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.827993 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.828081 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.828315 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.828404 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.828648 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.828756 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.828962 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.829051 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.829279 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.829379 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.829586 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.829675 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.829896 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.829984 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.830205 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.830296 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.830507 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.830602 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.830808 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.830905 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.831108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.831197 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.831414 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.831504 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.831717 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.831815 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.832063 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.832149 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.832348 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.832475 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.832706 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.832816 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.832999 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.833087 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.833316 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.833404 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.833620 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.833720 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.833921 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.834010 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.834222 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.834325 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.834526 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.834626 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.834853 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.834952 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.835155 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.835242 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.835494 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.835585 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.835809 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.835897 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.836151 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.836240 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.836490 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.836585 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.836807 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.836895 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.837121 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.837210 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.837589 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.837694 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.837778 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.837860 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.838029 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.838129 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.838338 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.838427 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.838660 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.838763 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.838967 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.839066 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.839280 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.839369 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.839585 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.839675 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.839893 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.839998 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.840201 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.840290 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.840543 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.840636 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.840846 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.840948 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.841153 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.841240 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.841464 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.841559 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.841772 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.841861 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.842101 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.842198 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.842414 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.842509 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.842720 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.842810 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.843033 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.843122 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.843338 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.843428 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.843648 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.843787 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.843956 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.844052 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.844265 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.844392 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.844606 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.844698 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.844925 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.845015 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.845234 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.845330 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.845543 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.845636 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.845862 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.845953 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.846169 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.846267 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.846484 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.846584 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.846788 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.846891 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.847107 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.847205 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.847410 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.847498 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.847736 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.847824 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.848042 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.848140 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.848350 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.848460 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.848694 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.848783 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.849004 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.849106 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.849314 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.849403 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.849623 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.849719 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.849932 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.850022 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.850234 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.850331 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.850540 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.850629 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.850850 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.850948 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.851157 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.851246 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.851463 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.851553 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.851810 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.851905 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.852123 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.852213 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.852430 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.852606 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.852751 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.852849 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.853053 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.853143 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.853361 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.853460 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.853679 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.853769 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.853988 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.854077 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.854308 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.854406 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.854624 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.854770 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.854922 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.855011 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.855222 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.855320 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.855538 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.855627 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.855841 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.855931 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.856140 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.856314 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.856483 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.856577 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.856763 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.856856 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.857098 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.857199 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.857405 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.857505 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.857706 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.857800 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.858019 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.858117 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.858329 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.858424 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.858633 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.859108 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.859295 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.859386 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.859601 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.859696 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.859911 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.859999 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.860220 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.860311 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.860557 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.860653 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.860865 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.860954 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.861179 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.861275 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.861487 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.861576 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.861795 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.861893 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.862105 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.862193 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.862412 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.862499 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.862721 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.862825 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.863028 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.863117 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.863335 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.863458 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.863636 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.863739 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.863940 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.864040 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.864247 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.864336 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.864614 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.864847 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.864938 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.865183 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.865272 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.865498 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.865595 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.865818 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.865907 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.866135 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.866229 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.866455 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.866552 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.866767 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.866854 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.867081 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.867169 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.867440 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.867540 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.867745 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.867834 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.868053 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.868142 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.868358 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.868469 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.868687 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.868785 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.868997 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.869087 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.869299 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.869387 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.869601 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.869690 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.869908 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.869997 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.870214 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.870311 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.870518 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.870608 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.870906 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.871117 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.871215 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.871417 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.871513 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.871725 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.871986 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.872074 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.872320 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.872408 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.872644 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.872734 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.872963 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.873063 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.873266 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.873364 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.873566 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.873655 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.873864 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.873968 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.874163 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.874252 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.874497 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.874586 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.874799 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.874909 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.875130 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.875244 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.875443 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.875547 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.875752 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.875842 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.876063 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.876153 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.876364 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.876479 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.876706 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.876805 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.877009 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.877099 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.877311 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.877408 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.877615 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.877704 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.877920 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.878016 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.878223 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.878310 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.878523 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.878611 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.878831 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.878918 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.879137 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.879232 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.879440 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.879542 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.879745 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.879840 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.880043 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.880131 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.880347 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.880686 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.880782 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.880866 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.880954 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.881036 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.881261 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.881359 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.881561 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.881649 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.881861 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.881951 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.882167 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.882289 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.882470 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.882622 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.882794 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.883061 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.883170 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.883376 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.883465 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.883688 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.883784 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.883991 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.884088 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.884292 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.884381 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.884619 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.884710 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.884927 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.885104 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.885232 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.885330 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.885535 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.885630 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.885841 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.885943 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.886145 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.886233 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.886446 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.886543 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.886744 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.886842 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.887048 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.887137 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.887346 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.887435 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.887645 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.887734 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.887947 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.888036 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.888261 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.888348 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.888595 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.888698 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.888900 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.888990 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.889205 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.889309 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.889501 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.889589 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.889808 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.889906 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.890108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.890206 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.890411 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.890500 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.890717 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.890805 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.891009 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.891106 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.891306 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.891396 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.891605 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.891695 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.891904 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.892007 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.892213 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.892301 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.892550 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.892643 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.892861 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.892962 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.893159 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.893247 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.893456 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.893551 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.893780 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.893880 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.894078 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.894166 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.894386 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.894473 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.894694 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.894783 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.895002 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.895098 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.895314 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.895409 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.895622 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.895725 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.895928 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.896017 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.896236 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.896337 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.896564 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.896666 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.896870 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.896958 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.897174 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.897271 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.897479 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.897567 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.897775 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.897862 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.898078 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.898180 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.898386 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.898473 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.898741 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.898831 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.899050 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.899197 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.899368 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.899467 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.899691 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.899788 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.900002 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.900098 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.900299 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.900388 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.900631 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.900722 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.900936 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.901032 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.901237 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.901326 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.901544 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.901633 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.901866 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.901956 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.902175 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.902264 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.902484 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.902573 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.902795 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.902893 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.903104 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.903201 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.903410 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.903509 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.903715 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.903807 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.904022 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.904110 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.904324 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.904421 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.904656 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.904757 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.904969 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.905066 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.905273 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.905380 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.905574 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.905664 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.905883 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.905980 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.906188 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.906285 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.906494 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.906584 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.906796 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.906885 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.907129 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.907227 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.907501 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.907599 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.907763 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.907860 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.908077 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.908175 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.908393 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.908538 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.908723 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.908810 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.909037 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.909128 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.909346 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.909440 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.909650 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.909748 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.909977 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.910066 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.910297 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.910386 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.910615 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.910704 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.910929 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.911035 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.911230 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.911325 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.911526 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.911624 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.911833 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.911922 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.912140 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.912235 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.912464 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.912569 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.912759 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.912848 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.913058 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.913159 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.913375 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.913473 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.913676 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.913764 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.913989 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.914075 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.914432 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.914741 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.914830 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.915043 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.915452 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.915679 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.915782 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.916011 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.916100 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.916336 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.916424 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.916678 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.916780 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.917001 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.917088 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.917304 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.917394 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.917612 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.917710 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.917919 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.918008 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.918240 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.918329 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.918559 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.918656 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.918865 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.918954 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.919176 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.919264 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.919475 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.919572 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.919801 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.919891 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.920118 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.920208 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.920428 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.920540 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.920765 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.920865 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.921117 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.921204 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.921428 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.921526 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.921738 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.921840 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.922065 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.922155 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.922374 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.922462 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.922674 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.922763 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.922976 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.923105 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.923282 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.923421 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.923583 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.923733 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.923881 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.924154 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.924242 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.924490 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.924584 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.924806 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.924895 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.925123 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.925254 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.925430 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.925530 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.925731 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.925821 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.926032 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.926120 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.926352 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.926443 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.926653 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.926756 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.926973 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.927064 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.927282 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.927372 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.927597 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.927687 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.927912 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.928008 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.928213 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.928304 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.928559 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.928651 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.928866 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.928968 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.929168 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.929258 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.929467 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.929556 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.929837 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.929974 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.930177 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.930307 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.930479 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.930626 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.930794 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.930954 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.931118 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.931282 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.931440 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.931594 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.931748 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.931904 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.932074 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.932219 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.932394 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.932553 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.932729 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.932865 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.933122 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.933218 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.933453 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.933551 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.933756 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.933846 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.934057 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.934154 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.934362 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.934452 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.934662 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.934752 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.934962 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.935051 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.935263 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.935366 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.935566 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.935656 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.935866 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.935955 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.936165 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.936269 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.936482 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.936588 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.936801 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.936900 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.937102 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.937201 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.937419 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.937509 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.937723 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.937812 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.938021 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.938119 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.938321 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.938410 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.938619 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.938715 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.938952 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.939043 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.939271 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.939361 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.939596 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.939685 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.939929 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.940019 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.940286 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.940542 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.940634 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.940868 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.940968 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.941207 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.941298 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.941528 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.941618 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.941843 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.941941 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.942155 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.942245 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.942466 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.942563 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.942779 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.942869 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.943089 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.943179 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.943400 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.943490 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.943706 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.943843 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.944013 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.944101 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.944320 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.944408 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.944658 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.944749 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.944968 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.945175 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.945265 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.945527 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.945633 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.945840 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.945938 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.946151 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.946239 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.946459 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.946548 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.946770 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.946860 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.947081 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.947170 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.947387 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.947477 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.947695 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.947784 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.948001 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.948089 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.948306 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.948397 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.948655 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.948758 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.948973 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.949109 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.949309 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.949404 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.949645 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.949925 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.950014 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.950270 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.950521 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.950612 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.950899 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.951108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.951206 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.951521 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.951610 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.951844 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.952137 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.952228 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.952485 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.952596 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.952801 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.952891 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.953122 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.953219 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.953441 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.953532 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.953756 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.953852 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.954071 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.954292 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.954396 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.954632 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.954869 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.954958 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.955186 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.955278 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.955500 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.955598 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.955813 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.955902 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.956121 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.956224 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.956457 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.956549 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.956799 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.956963 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.957118 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.957287 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.957433 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.957717 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.957806 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.958076 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.958299 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.958403 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.958730 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.958886 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.959051 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.959373 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.959470 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.959694 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.960013 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.960104 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.960376 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.960724 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.961120 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.961212 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.961445 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.961535 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.961765 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.961868 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.962083 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.962172 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.962399 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.962489 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.962718 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.962816 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.963035 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.963132 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.963353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.963443 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.963670 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.963781 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.963982 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.964262 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.964352 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.964601 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.964694 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.964915 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.965007 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.965222 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.965313 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.965546 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.965757 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.965855 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.965934 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.966152 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.966248 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.966473 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.966573 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.966784 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.967001 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.967314 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.967417 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.967656 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.967754 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.967970 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.968068 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.968295 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.968384 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.968645 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.968738 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.968963 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.969054 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.969270 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.969367 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.969590 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.969687 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.969907 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.970041 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.970201 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.970291 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.970512 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.970602 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.970826 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.970914 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.971130 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.971220 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.971435 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.971534 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.971744 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.971835 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.972054 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.972154 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.972358 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.972501 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.972694 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.972914 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.973011 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.973268 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.973359 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.973589 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.973727 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.973895 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.973984 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.974200 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.974290 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.974512 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.974603 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.974816 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.974905 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.975120 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.975237 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.975422 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.975541 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.975724 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.975823 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.976030 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.976120 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.976330 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.976421 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.976706 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.976827 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.977005 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.977146 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.977316 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.977470 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.977615 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.977787 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.977919 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.978100 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.978262 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.978414 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.978583 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.978724 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.978886 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.979055 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.979185 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.979366 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.979495 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.979675 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.979803 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.979983 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.980125 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.980301 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.980482 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.980639 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.980770 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.980947 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.981113 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.981256 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.981427 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.981566 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.981883 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.981971 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.982191 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.982280 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.982504 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.982595 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.982814 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.982904 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.983130 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.983232 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.983437 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.983526 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.984089 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.984190 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.984407 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.984573 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.984761 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.984852 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.985071 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.985161 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.985379 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.985477 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.985680 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.985778 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.985988 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.986149 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.986293 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.986397 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.986597 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.986696 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.986903 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.987000 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.987210 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.987301 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.987515 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.987605 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.987820 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.988081 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.988180 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.988415 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.988536 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.988744 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.988837 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.989082 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.989180 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.989399 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.989495 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.989710 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.989799 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.990019 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.990161 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.990326 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.990416 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.990804 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.990927 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.991051 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.991169 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.991260 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.991350 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.991511 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.991610 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.991829 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.991922 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.992145 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.992243 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.992557 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.992665 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.992867 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.992957 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.993177 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.993286 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.993490 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.993599 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.993804 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.993894 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.994117 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.994243 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.994430 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.994530 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.994747 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.994838 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.995091 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.995181 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.995414 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.995505 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.995733 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.995821 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.996039 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.996135 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.996358 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.996489 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.996697 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.996787 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.997011 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.997110 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.997329 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.997427 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.997631 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.997735 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.997931 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.998028 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.998232 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.998323 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.998537 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.998626 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.998853 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.998955 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.999157 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.999287 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.999458 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.999604 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.999757 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:58.999939 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.000063 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.000267 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.000359 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.000616 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.000707 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.000959 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.001050 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.001256 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.001346 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.001565 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.001668 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.001863 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.001957 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.002162 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.002251 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.002462 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.002564 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.002761 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.002851 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.003062 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.003151 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.003363 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.003464 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.003667 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.003764 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.003971 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.004062 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.004272 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.004413 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.004594 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.004694 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.004893 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.004984 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.005192 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.005284 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.005518 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.005607 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.005846 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.005943 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.006156 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.006251 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.006465 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.006557 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.006772 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.006861 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.007081 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.007171 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.007387 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.007475 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.007696 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.007784 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.008059 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.008152 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.008372 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.008483 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.008705 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.008814 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.009011 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.009120 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.009321 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.009410 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.009629 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.009726 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.009938 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.010026 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.010243 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.010377 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.010551 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.010654 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.010857 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.010946 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.011161 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.011273 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.011474 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.011628 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.011770 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.011865 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.012092 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.012183 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.012407 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.012538 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.012747 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.012846 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.013063 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.013152 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.013375 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.013465 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.013686 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.013775 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.013998 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.014086 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.014309 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.014419 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.014623 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.014730 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.014927 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.015025 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.015237 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.015327 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.015550 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.015639 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.015864 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.015963 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.016178 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.016275 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.016519 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.016619 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.016825 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.016929 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.017140 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.017236 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.017457 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.017553 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.017787 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.017877 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.018097 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.018186 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.018423 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.018510 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.018745 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.018838 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.019053 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.019141 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.019365 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.019461 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.019669 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.019759 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.019911 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 20:27:59.020000 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.020299 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.020641 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.020960 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.021275 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.021599 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.021922 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.022242 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.022572 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.022902 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.023215 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.023619 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.023956 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.024309 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.024658 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.025006 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.025342 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.025663 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.025979 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.026293 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:27:59.026537 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 20:27:59.043353 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_db.sqlalchemy.engines [None req-2dc00bf5-976c-4e76-bda1-4f5a75c6b50b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102757) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 20:27:59.049183 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG oslo_db.sqlalchemy.engines [None req-d158a0f1-bce4-4e49-bbb4-8c237a0f5859 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102756) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 20:27:59.104877 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.context [None req-2dc00bf5-976c-4e76-bda1-4f5a75c6b50b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1402e959-c99d-408c-abcd-23ab2c728bba(cell1) {{(pid=102757) load_cells /opt/stack/nova/nova/context.py:464}} May 16 20:27:59.109563 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_concurrency.lockutils [None req-2dc00bf5-976c-4e76-bda1-4f5a75c6b50b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:27:59.111119 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_concurrency.lockutils [None req-2dc00bf5-976c-4e76-bda1-4f5a75c6b50b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:27:59.111905 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_concurrency.lockutils [None req-2dc00bf5-976c-4e76-bda1-4f5a75c6b50b None None] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:27:59.112050 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.context [None req-d158a0f1-bce4-4e49-bbb4-8c237a0f5859 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1402e959-c99d-408c-abcd-23ab2c728bba(cell1) {{(pid=102756) load_cells /opt/stack/nova/nova/context.py:464}} May 16 20:27:59.113859 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_concurrency.lockutils [None req-2dc00bf5-976c-4e76-bda1-4f5a75c6b50b None None] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:27:59.116278 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG oslo_concurrency.lockutils [None req-d158a0f1-bce4-4e49-bbb4-8c237a0f5859 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:27:59.118010 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG oslo_concurrency.lockutils [None req-d158a0f1-bce4-4e49-bbb4-8c237a0f5859 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:27:59.118815 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG oslo_concurrency.lockutils [None req-d158a0f1-bce4-4e49-bbb4-8c237a0f5859 None None] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:27:59.120811 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG oslo_concurrency.lockutils [None req-d158a0f1-bce4-4e49-bbb4-8c237a0f5859 None None] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:27:59.124650 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_db.sqlalchemy.engines [None req-2dc00bf5-976c-4e76-bda1-4f5a75c6b50b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102757) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 20:27:59.127971 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_db.sqlalchemy.engines [None req-2dc00bf5-976c-4e76-bda1-4f5a75c6b50b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102757) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 20:27:59.135647 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG oslo_db.sqlalchemy.engines [None req-d158a0f1-bce4-4e49-bbb4-8c237a0f5859 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102756) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 20:27:59.139556 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG oslo_db.sqlalchemy.engines [None req-d158a0f1-bce4-4e49-bbb4-8c237a0f5859 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102756) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 20:27:59.294517 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_db.sqlalchemy.engines [None req-2dc00bf5-976c-4e76-bda1-4f5a75c6b50b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102757) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 20:27:59.302087 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG oslo_db.sqlalchemy.engines [None req-d158a0f1-bce4-4e49-bbb4-8c237a0f5859 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102756) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 20:27:59.635890 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: WARNING keystonemiddleware.auth_token [None req-2dc00bf5-976c-4e76-bda1-4f5a75c6b50b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 20:27:59.638682 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: WARNING keystonemiddleware.auth_token [None req-d158a0f1-bce4-4e49-bbb4-8c237a0f5859 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 20:27:59.642627 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: WARNING keystonemiddleware.auth_token [None req-2dc00bf5-976c-4e76-bda1-4f5a75c6b50b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 20:27:59.646835 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: WARNING keystonemiddleware.auth_token [None req-d158a0f1-bce4-4e49-bbb4-8c237a0f5859 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 20:27:59.986585 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: WARNING keystonemiddleware.auth_token [None req-2dc00bf5-976c-4e76-bda1-4f5a75c6b50b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 20:27:59.992768 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: WARNING keystonemiddleware.auth_token [None req-d158a0f1-bce4-4e49-bbb4-8c237a0f5859 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 20:27:59.993178 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: WARNING keystonemiddleware.auth_token [None req-2dc00bf5-976c-4e76-bda1-4f5a75c6b50b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 20:27:59.998818 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fccf62a9c0 pid: 102757 (default app) May 16 20:27:59.998976 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: WARNING keystonemiddleware.auth_token [None req-d158a0f1-bce4-4e49-bbb4-8c237a0f5859 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 20:28:00.000959 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-2dc00bf5-976c-4e76-bda1-4f5a75c6b50b None None] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:28:00.002252 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-2dc00bf5-976c-4e76-bda1-4f5a75c6b50b None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001828 May 16 20:28:00.002632 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Mon May 16 20:27:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:28:00.005822 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fccf62a9c0 pid: 102756 (default app) May 16 20:29:17.668126 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-2dc00bf5-976c-4e76-bda1-4f5a75c6b50b None None] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:29:17.669252 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-2dc00bf5-976c-4e76-bda1-4f5a75c6b50b None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 May 16 20:29:17.669649 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 930 bytes} [Mon May 16 20:29:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:29:18.087521 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-617b15d3-0ccd-4312-b05e-d5c2bfbb7071 admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:29:18.117115 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-617b15d3-0ccd-4312-b05e-d5c2bfbb7071 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.440279 May 16 20:29:18.117885 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1291 bytes} [Mon May 16 20:29:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:29:20.369346 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-2dc00bf5-976c-4e76-bda1-4f5a75c6b50b None None] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:29:20.370353 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-2dc00bf5-976c-4e76-bda1-4f5a75c6b50b None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 May 16 20:29:20.373416 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 930 bytes} [Mon May 16 20:29:20 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:29:20.433095 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-28a60142-8baa-4f28-a318-03d0e056ab8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:29:20.451571 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 20:29:20.451571 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: warnings.warn(msg) May 16 20:29:20.482588 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-28a60142-8baa-4f28-a318-03d0e056ab8e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106198 May 16 20:29:20.483167 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1282 bytes} [Mon May 16 20:29:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 20:29:20.694623 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-ff709a5b-facd-483f-bb29-2faf7efd79c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:29:20.697045 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 20:29:20.697045 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: warnings.warn(msg) May 16 20:29:20.749069 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-ff709a5b-facd-483f-bb29-2faf7efd79c9 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.257923 May 16 20:29:20.752672 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1335 bytes} [Mon May 16 20:29:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:29:23.023398 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-28a60142-8baa-4f28-a318-03d0e056ab8e admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:29:23.024509 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-28a60142-8baa-4f28-a318-03d0e056ab8e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 16 20:29:23.024864 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 930 bytes} [Mon May 16 20:29:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:29:23.143680 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-7de1f28e-b76b-4f86-be4a-73c9dc60e806 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 5, "swap": 0, "id": "d1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512}} {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:29:23.161336 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 20:29:23.161336 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: warnings.warn(msg) May 16 20:29:23.180719 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-7de1f28e-b76b-4f86-be4a-73c9dc60e806 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.149833 May 16 20:29:23.181283 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1282 bytes} [Mon May 16 20:29:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 20:29:23.193050 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-45d171ea-f6df-4249-98d6-0f49cc02f4a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:29:23.194454 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 20:29:23.194454 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: warnings.warn(msg) May 16 20:29:23.226339 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-45d171ea-f6df-4249-98d6-0f49cc02f4a9 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037122 May 16 20:29:23.227088 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1335 bytes} [Mon May 16 20:29:23 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:29:25.499185 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-7de1f28e-b76b-4f86-be4a-73c9dc60e806 admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:29:25.500303 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-7de1f28e-b76b-4f86-be4a-73c9dc60e806 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 May 16 20:29:25.500944 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 930 bytes} [Mon May 16 20:29:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:29:25.560287 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-6d170dee-9f88-45f4-b7b1-680d1c4ec503 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "id": "d2", "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:29:25.580896 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-6d170dee-9f88-45f4-b7b1-680d1c4ec503 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073915 May 16 20:29:25.584482 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1282 bytes} [Mon May 16 20:29:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 20:29:25.593603 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-5523d93c-19cc-43b5-b419-5213461192f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:29:25.622027 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-5523d93c-19cc-43b5-b419-5213461192f6 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032087 May 16 20:29:25.622810 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1335 bytes} [Mon May 16 20:29:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:29:27.912849 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-6d170dee-9f88-45f4-b7b1-680d1c4ec503 admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:29:27.913887 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-6d170dee-9f88-45f4-b7b1-680d1c4ec503 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 May 16 20:29:27.914300 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 930 bytes} [Mon May 16 20:29:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:29:27.978437 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-2a87d289-c953-4327-b8d9-4be1ed9f034b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "swap": 0, "vcpus": 2, "disk": 10, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:29:27.997959 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-2a87d289-c953-4327-b8d9-4be1ed9f034b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076983 May 16 20:29:27.998543 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1282 bytes} [Mon May 16 20:29:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 20:29:28.011818 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-2501c582-f058-4c8d-9b97-51e5bb3ca1db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:29:28.035920 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-2501c582-f058-4c8d-9b97-51e5bb3ca1db admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027964 May 16 20:29:28.036463 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1335 bytes} [Mon May 16 20:29:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:29:30.280581 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-2a87d289-c953-4327-b8d9-4be1ed9f034b admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:29:30.281598 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-2a87d289-c953-4327-b8d9-4be1ed9f034b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 May 16 20:29:30.282271 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 930 bytes} [Mon May 16 20:29:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:29:30.342233 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-e3a56ae7-2446-4749-895b-98a0428ed678 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "ds4G", "vcpus": 4, "id": "d4"}} {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:29:30.361469 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-e3a56ae7-2446-4749-895b-98a0428ed678 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073452 May 16 20:29:30.362313 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1282 bytes} [Mon May 16 20:29:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 20:29:30.374133 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-3be6246a-74e5-41d9-a0b5-916019127d4f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:29:30.398783 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-3be6246a-74e5-41d9-a0b5-916019127d4f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028172 May 16 20:29:30.400808 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1335 bytes} [Mon May 16 20:29:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:29:32.634146 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-e3a56ae7-2446-4749-895b-98a0428ed678 admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:29:32.635786 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-e3a56ae7-2446-4749-895b-98a0428ed678 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 May 16 20:29:32.636671 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 930 bytes} [Mon May 16 20:29:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:29:32.711002 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-8ddf7548-fc22-449c-bf86-0e3f16629bb2 admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:29:32.735087 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-8ddf7548-fc22-449c-bf86-0e3f16629bb2 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.091888 May 16 20:29:32.735823 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1291 bytes} [Mon May 16 20:29:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:29:35.029216 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-e3a56ae7-2446-4749-895b-98a0428ed678 admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:29:35.030377 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-e3a56ae7-2446-4749-895b-98a0428ed678 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001875 May 16 20:29:35.030826 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 930 bytes} [Mon May 16 20:29:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:29:35.096594 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-df7327fa-d682-45b3-8435-d91d411e31a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "swap": 0, "disk": 1, "name": "m1.tiny"}} {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:29:35.119057 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-df7327fa-d682-45b3-8435-d91d411e31a7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080223 May 16 20:29:35.119654 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1282 bytes} [Mon May 16 20:29:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 20:29:35.132186 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-7388070d-abbb-4049-a12e-ee0a23333a78 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:29:35.160778 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-7388070d-abbb-4049-a12e-ee0a23333a78 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032293 May 16 20:29:35.161583 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1332 bytes} [Mon May 16 20:29:35 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:29:37.562654 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-df7327fa-d682-45b3-8435-d91d411e31a7 admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:29:37.563843 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-df7327fa-d682-45b3-8435-d91d411e31a7 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001727 May 16 20:29:37.564261 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 930 bytes} [Mon May 16 20:29:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:29:37.629130 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-905cfa0e-3664-4428-bd0b-2d5f0ab557b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "disk": 20, "name": "m1.small"}} {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:29:37.648780 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-905cfa0e-3664-4428-bd0b-2d5f0ab557b1 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078338 May 16 20:29:37.649402 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1282 bytes} [Mon May 16 20:29:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 20:29:37.664732 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-1797fe4b-aff5-4e5e-a11c-65b721ce11e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:29:37.692463 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-1797fe4b-aff5-4e5e-a11c-65b721ce11e4 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031789 May 16 20:29:37.693166 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1332 bytes} [Mon May 16 20:29:37 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:29:40.142879 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-905cfa0e-3664-4428-bd0b-2d5f0ab557b1 admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:29:40.143917 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-905cfa0e-3664-4428-bd0b-2d5f0ab557b1 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 May 16 20:29:40.144333 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 930 bytes} [Mon May 16 20:29:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:29:40.201396 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-5816afad-2238-4a78-b8ff-cd615e6e27ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "3", "disk": 40, "vcpus": 2, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:29:40.220293 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-5816afad-2238-4a78-b8ff-cd615e6e27ce admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070059 May 16 20:29:40.220873 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1282 bytes} [Mon May 16 20:29:40 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 20:29:40.232885 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-b524d26d-e9c2-4761-8b49-1d29dfe572fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:29:40.255680 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-b524d26d-e9c2-4761-8b49-1d29dfe572fa admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026463 May 16 20:29:40.256236 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1332 bytes} [Mon May 16 20:29:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:29:42.493826 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-5816afad-2238-4a78-b8ff-cd615e6e27ce admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:29:42.494871 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-5816afad-2238-4a78-b8ff-cd615e6e27ce admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 May 16 20:29:42.495302 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 930 bytes} [Mon May 16 20:29:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:29:42.551416 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-f08930b5-18fc-489c-a77f-69cb77b267fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "ram": 8192, "rxtx_factor": 1.0, "disk": 80}} {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:29:42.573070 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-f08930b5-18fc-489c-a77f-69cb77b267fe admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071710 May 16 20:29:42.573545 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1282 bytes} [Mon May 16 20:29:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 20:29:42.585297 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-c156e26d-ebf5-4998-ae01-49a2c097004e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:29:42.608826 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-c156e26d-ebf5-4998-ae01-49a2c097004e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027144 May 16 20:29:42.609463 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1332 bytes} [Mon May 16 20:29:42 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:29:44.898341 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-f08930b5-18fc-489c-a77f-69cb77b267fe admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:29:44.900143 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-f08930b5-18fc-489c-a77f-69cb77b267fe admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002280 May 16 20:29:44.912928 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 930 bytes} [Mon May 16 20:29:44 2022] GET /compute/v2.1 => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:29:44.985796 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-6e9f316f-3730-424b-9324-6afd0e995fb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "ram": 16384, "id": "5"}} {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:29:45.006926 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-6e9f316f-3730-424b-9324-6afd0e995fb7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.097575 May 16 20:29:45.007499 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1282 bytes} [Mon May 16 20:29:44 2022] POST /compute/v2.1/flavors => generated 408 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 20:29:45.022363 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-724c03ef-b27f-4fa5-868e-e324d656d865 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:29:45.052982 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-724c03ef-b27f-4fa5-868e-e324d656d865 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037311 May 16 20:29:45.053677 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1332 bytes} [Mon May 16 20:29:45 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:30:08.817002 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-6e9f316f-3730-424b-9324-6afd0e995fb7 admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:08.818356 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-6e9f316f-3730-424b-9324-6afd0e995fb7 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002055 May 16 20:30:08.818964 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 930 bytes} [Mon May 16 20:30:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:30:08.890610 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-79a8c9ad-aec7-4d01-8aee-3b11a976fe88 admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:08.909354 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-79a8c9ad-aec7-4d01-8aee-3b11a976fe88 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.081121 May 16 20:30:08.909860 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1291 bytes} [Mon May 16 20:30:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:30:09.931075 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-6e9f316f-3730-424b-9324-6afd0e995fb7 admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:09.932085 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-6e9f316f-3730-424b-9324-6afd0e995fb7 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 16 20:30:09.932515 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Mon May 16 20:30:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:30:10.134231 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-dfcaf75b-d735-4844-98fe-40d50aebe4cb admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:10.141126 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.wsgi [None req-dfcaf75b-d735-4844-98fe-40d50aebe4cb admin admin] HTTP exception thrown: Flavor 42 could not be found. May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-dfcaf75b-d735-4844-98fe-40d50aebe4cb admin admin] Request method failure captured: May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Accept: application/json May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Accept-Encoding: gzip, deflate May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Connection: keep-alive May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Content-Length: 0 May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Host: 10.222.0.49 May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Openstack-Api-Version: compute 2.90 May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Openstack-System-Scope: None May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: User-Agent: python-novaclient May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Auth-Token: gAAAAABigrRRxBvmHouEVh0gwRRu4Y6s8HQUBrQzTtjP6m-D1dv1XITxDPRDmsSw_tpLEaec6w33jSVy4wLt9x7FE5tOCJuehD8z-XTucFJ8Zv3FINbcsE_6X1w8BpmsVLDncrK1G33f3zgtWC1xfQNpZIsq5i-I0tLYJB20Ya2kzD-cF8ncOT8 May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Domain-Id: None May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Domain-Name: None May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Identity-Status: Confirmed May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Is-Admin-Project: True May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Openstack-Nova-Api-Version: 2.90 May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Project-Domain-Id: default May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Project-Domain-Name: Default May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Project-Id: cd0e31e92b6648feab627c19ac9bf98d May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Project-Name: admin May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Role: reader,member,admin May 16 20:30:10.144370 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Roles: reader,member,admin May 16 20:30:10.146031 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cd0e31e92b6648feab627c19ac9bf98d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd0e31e92b6648feab627c19ac9bf98d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cd0e31e92b6648feab627c19ac9bf98d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd0e31e92b6648feab627c19ac9bf98d"}]}] May 16 20:30:10.146031 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Tenant: admin May 16 20:30:10.146031 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Tenant-Id: cd0e31e92b6648feab627c19ac9bf98d May 16 20:30:10.146031 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Tenant-Name: admin May 16 20:30:10.146031 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-User: admin May 16 20:30:10.146031 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-User-Domain-Id: default May 16 20:30:10.146031 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-User-Domain-Name: Default May 16 20:30:10.146031 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-User-Id: fc0c07a955fe4edc868e35eb1b8525a2 May 16 20:30:10.146031 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-User-Name: admin May 16 20:30:10.146031 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: method: > May 16 20:30:10.146031 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: exception: Flavor 42 could not be found. May 16 20:30:10.146031 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: action_args: {'id': '42'} May 16 20:30:10.146031 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:30:10.146031 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:30:10.147056 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 20:30:10.147056 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 20:30:10.147056 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 20:30:10.147056 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 20:30:10.147056 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 20:30:10.147056 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 20:30:10.147056 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 20:30:10.147056 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 20:30:10.147056 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 20:30:10.147056 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:30:10.147056 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 20:30:10.147056 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 20:30:10.147056 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 16 20:30:10.147056 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi May 16 20:30:10.147056 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:30:10.147056 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi May 16 20:30:10.147056 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:30:10.147056 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:30:10.147056 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:30:10.148210 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:30:10.148210 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:30:10.148210 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:30:10.148210 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:30:10.148210 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 20:30:10.148210 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 20:30:10.148210 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 16 20:30:10.148210 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi May 16 20:30:10.148210 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:30:10.148210 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi May 16 20:30:10.148210 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:30:10.148210 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:30:10.148210 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:30:10.148210 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:30:10.148210 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:30:10.148210 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 16 20:30:10.148210 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi May 16 20:30:10.148210 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-dfcaf75b-d735-4844-98fe-40d50aebe4cb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:30:10.149351 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-dfcaf75b-d735-4844-98fe-40d50aebe4cb admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.066716 May 16 20:30:10.149351 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Mon May 16 20:30:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 20:30:10.156015 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-a2a1a58b-e20c-4157-b295-08a0122c74a1 admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:10.178230 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-a2a1a58b-e20c-4157-b295-08a0122c74a1 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025931 May 16 20:30:10.178816 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Mon May 16 20:30:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:30:10.188881 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-eb5efe04-a328-4f55-9d5c-d3c34962300a admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:10.210986 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-eb5efe04-a328-4f55-9d5c-d3c34962300a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025803 May 16 20:30:10.211540 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Mon May 16 20:30:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:30:10.220844 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-9986f79e-e748-4fb7-95cf-9756827cf5f7 admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:10.226864 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.wsgi [None req-9986f79e-e748-4fb7-95cf-9756827cf5f7 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-9986f79e-e748-4fb7-95cf-9756827cf5f7 admin admin] Request method failure captured: May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Accept: application/json May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Accept-Encoding: gzip, deflate May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Connection: keep-alive May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Content-Length: 0 May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Host: 10.222.0.49 May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Openstack-Api-Version: compute 2.90 May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Openstack-System-Scope: None May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: User-Agent: python-novaclient May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Auth-Token: gAAAAABigrRRxBvmHouEVh0gwRRu4Y6s8HQUBrQzTtjP6m-D1dv1XITxDPRDmsSw_tpLEaec6w33jSVy4wLt9x7FE5tOCJuehD8z-XTucFJ8Zv3FINbcsE_6X1w8BpmsVLDncrK1G33f3zgtWC1xfQNpZIsq5i-I0tLYJB20Ya2kzD-cF8ncOT8 May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Domain-Id: None May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Domain-Name: None May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Identity-Status: Confirmed May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Is-Admin-Project: True May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Openstack-Nova-Api-Version: 2.90 May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Project-Domain-Id: default May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Project-Domain-Name: Default May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Project-Id: cd0e31e92b6648feab627c19ac9bf98d May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Project-Name: admin May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Role: reader,member,admin May 16 20:30:10.230108 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Roles: reader,member,admin May 16 20:30:10.231592 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cd0e31e92b6648feab627c19ac9bf98d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd0e31e92b6648feab627c19ac9bf98d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cd0e31e92b6648feab627c19ac9bf98d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd0e31e92b6648feab627c19ac9bf98d"}]}] May 16 20:30:10.231592 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Tenant: admin May 16 20:30:10.231592 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Tenant-Id: cd0e31e92b6648feab627c19ac9bf98d May 16 20:30:10.231592 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Tenant-Name: admin May 16 20:30:10.231592 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-User: admin May 16 20:30:10.231592 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-User-Domain-Id: default May 16 20:30:10.231592 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-User-Domain-Name: Default May 16 20:30:10.231592 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-User-Id: fc0c07a955fe4edc868e35eb1b8525a2 May 16 20:30:10.231592 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-User-Name: admin May 16 20:30:10.231592 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: method: > May 16 20:30:10.231592 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: exception: Flavor 42 could not be found. May 16 20:30:10.231592 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: action_args: {'id': '42'} May 16 20:30:10.231592 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:30:10.231592 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:30:10.232628 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 20:30:10.232628 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 20:30:10.232628 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 20:30:10.232628 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 20:30:10.232628 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 20:30:10.232628 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 20:30:10.232628 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 20:30:10.232628 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 20:30:10.232628 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 20:30:10.232628 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:30:10.232628 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 20:30:10.232628 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 20:30:10.232628 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 16 20:30:10.232628 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi May 16 20:30:10.232628 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:30:10.232628 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi May 16 20:30:10.232628 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:30:10.232628 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:30:10.232628 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:30:10.233984 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:30:10.233984 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:30:10.233984 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:30:10.233984 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:30:10.233984 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 20:30:10.233984 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 20:30:10.233984 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 16 20:30:10.233984 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi May 16 20:30:10.233984 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:30:10.233984 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi May 16 20:30:10.233984 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:30:10.233984 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:30:10.233984 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:30:10.233984 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:30:10.233984 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:30:10.233984 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 16 20:30:10.233984 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi May 16 20:30:10.233984 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-9986f79e-e748-4fb7-95cf-9756827cf5f7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:30:10.236404 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-9986f79e-e748-4fb7-95cf-9756827cf5f7 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014181 May 16 20:30:10.236404 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Mon May 16 20:30:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 20:30:11.119174 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-eb5efe04-a328-4f55-9d5c-d3c34962300a admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:11.120195 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-eb5efe04-a328-4f55-9d5c-d3c34962300a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 16 20:30:11.120635 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Mon May 16 20:30:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:30:11.322418 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-e316abc8-e09a-4d1e-94aa-84d0ffe1a8d5 admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:11.327912 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.wsgi [None req-e316abc8-e09a-4d1e-94aa-84d0ffe1a8d5 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-e316abc8-e09a-4d1e-94aa-84d0ffe1a8d5 admin admin] Request method failure captured: May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Accept: application/json May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Accept-Encoding: gzip, deflate May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Connection: keep-alive May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Content-Length: 0 May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Host: 10.222.0.49 May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Openstack-Api-Version: compute 2.90 May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Openstack-System-Scope: None May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: User-Agent: python-novaclient May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Auth-Token: gAAAAABigrRTEsSU8BgbypUnznGrXB79fpMyRmLz2qb6g9TEO4hXENUfaqNBeMwv_SEr1q2cXNLzhG3cuc7-PrvUH9rb0bcLMAhx2GhRjDBuz4JO5PzKQlAt0nHoTEGCbg6uq_xe9j74VSDTc474OvnlkgxJRyn-gali150qi22QzYAxKs1ssdM May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Domain-Id: None May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Domain-Name: None May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Identity-Status: Confirmed May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Is-Admin-Project: True May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Openstack-Nova-Api-Version: 2.90 May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Project-Domain-Id: default May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Project-Domain-Name: Default May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Project-Id: cd0e31e92b6648feab627c19ac9bf98d May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Project-Name: admin May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Role: reader,member,admin May 16 20:30:11.329388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Roles: reader,member,admin May 16 20:30:11.330741 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cd0e31e92b6648feab627c19ac9bf98d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd0e31e92b6648feab627c19ac9bf98d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cd0e31e92b6648feab627c19ac9bf98d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd0e31e92b6648feab627c19ac9bf98d"}]}] May 16 20:30:11.330741 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Tenant: admin May 16 20:30:11.330741 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Tenant-Id: cd0e31e92b6648feab627c19ac9bf98d May 16 20:30:11.330741 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Tenant-Name: admin May 16 20:30:11.330741 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-User: admin May 16 20:30:11.330741 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-User-Domain-Id: default May 16 20:30:11.330741 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-User-Domain-Name: Default May 16 20:30:11.330741 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-User-Id: fc0c07a955fe4edc868e35eb1b8525a2 May 16 20:30:11.330741 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-User-Name: admin May 16 20:30:11.330741 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: method: > May 16 20:30:11.330741 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: exception: Flavor 84 could not be found. May 16 20:30:11.330741 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: action_args: {'id': '84'} May 16 20:30:11.330741 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:30:11.330741 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:30:11.331539 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 20:30:11.331539 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 20:30:11.331539 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 20:30:11.331539 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 20:30:11.331539 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 20:30:11.331539 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 20:30:11.331539 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 20:30:11.331539 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 20:30:11.331539 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 20:30:11.331539 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:30:11.331539 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 20:30:11.331539 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 20:30:11.331539 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 16 20:30:11.331539 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi May 16 20:30:11.331539 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:30:11.331539 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi May 16 20:30:11.331539 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:30:11.331539 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:30:11.331539 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:30:11.332658 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:30:11.332658 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:30:11.332658 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:30:11.332658 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:30:11.332658 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 20:30:11.332658 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 20:30:11.332658 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 16 20:30:11.332658 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi May 16 20:30:11.332658 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:30:11.332658 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi May 16 20:30:11.332658 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:30:11.332658 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:30:11.332658 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:30:11.332658 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:30:11.332658 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:30:11.332658 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 16 20:30:11.332658 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi May 16 20:30:11.332658 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-e316abc8-e09a-4d1e-94aa-84d0ffe1a8d5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:30:11.333778 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-e316abc8-e09a-4d1e-94aa-84d0ffe1a8d5 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.074435 May 16 20:30:11.333778 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Mon May 16 20:30:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 20:30:11.341032 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-358bdca5-faf0-4e41-96a5-78908b2f2ced admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:11.355127 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-358bdca5-faf0-4e41-96a5-78908b2f2ced admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017725 May 16 20:30:11.355649 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Mon May 16 20:30:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:30:11.364904 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-098de49a-3e7c-4f95-bdaf-7652ad9a16e6 admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:11.378484 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-098de49a-3e7c-4f95-bdaf-7652ad9a16e6 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017039 May 16 20:30:11.379016 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Mon May 16 20:30:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:30:11.387814 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-65804f0e-efad-4142-ba85-2130dcaaf859 admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:11.393075 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.wsgi [None req-65804f0e-efad-4142-ba85-2130dcaaf859 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-65804f0e-efad-4142-ba85-2130dcaaf859 admin admin] Request method failure captured: May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Accept: application/json May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Accept-Encoding: gzip, deflate May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Connection: keep-alive May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Content-Length: 0 May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Host: 10.222.0.49 May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Openstack-Api-Version: compute 2.90 May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Openstack-System-Scope: None May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: User-Agent: python-novaclient May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Auth-Token: gAAAAABigrRTEsSU8BgbypUnznGrXB79fpMyRmLz2qb6g9TEO4hXENUfaqNBeMwv_SEr1q2cXNLzhG3cuc7-PrvUH9rb0bcLMAhx2GhRjDBuz4JO5PzKQlAt0nHoTEGCbg6uq_xe9j74VSDTc474OvnlkgxJRyn-gali150qi22QzYAxKs1ssdM May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Domain-Id: None May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Domain-Name: None May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Identity-Status: Confirmed May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Is-Admin-Project: True May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Openstack-Nova-Api-Version: 2.90 May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Project-Domain-Id: default May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Project-Domain-Name: Default May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Project-Id: cd0e31e92b6648feab627c19ac9bf98d May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Project-Name: admin May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Role: reader,member,admin May 16 20:30:11.394574 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Roles: reader,member,admin May 16 20:30:11.396089 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cd0e31e92b6648feab627c19ac9bf98d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd0e31e92b6648feab627c19ac9bf98d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cd0e31e92b6648feab627c19ac9bf98d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd0e31e92b6648feab627c19ac9bf98d"}]}] May 16 20:30:11.396089 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Tenant: admin May 16 20:30:11.396089 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Tenant-Id: cd0e31e92b6648feab627c19ac9bf98d May 16 20:30:11.396089 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Tenant-Name: admin May 16 20:30:11.396089 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-User: admin May 16 20:30:11.396089 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-User-Domain-Id: default May 16 20:30:11.396089 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-User-Domain-Name: Default May 16 20:30:11.396089 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-User-Id: fc0c07a955fe4edc868e35eb1b8525a2 May 16 20:30:11.396089 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-User-Name: admin May 16 20:30:11.396089 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: method: > May 16 20:30:11.396089 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: exception: Flavor 84 could not be found. May 16 20:30:11.396089 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: action_args: {'id': '84'} May 16 20:30:11.396089 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:30:11.396089 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:30:11.397131 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 20:30:11.397131 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 20:30:11.397131 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 20:30:11.397131 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 20:30:11.397131 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 20:30:11.397131 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 20:30:11.397131 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 20:30:11.397131 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 20:30:11.397131 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 20:30:11.397131 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:30:11.397131 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 20:30:11.397131 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 20:30:11.397131 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 16 20:30:11.397131 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi May 16 20:30:11.397131 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:30:11.397131 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi May 16 20:30:11.397131 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:30:11.397131 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:30:11.397131 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:30:11.398438 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:30:11.398438 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:30:11.398438 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:30:11.398438 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:30:11.398438 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 20:30:11.398438 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 20:30:11.398438 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 16 20:30:11.398438 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi May 16 20:30:11.398438 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:30:11.398438 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi May 16 20:30:11.398438 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:30:11.398438 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:30:11.398438 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:30:11.398438 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:30:11.398438 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:30:11.398438 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 16 20:30:11.398438 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi May 16 20:30:11.398438 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-65804f0e-efad-4142-ba85-2130dcaaf859 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:30:11.399714 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-65804f0e-efad-4142-ba85-2130dcaaf859 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011506 May 16 20:30:11.399714 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Mon May 16 20:30:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 20:30:12.279087 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-098de49a-3e7c-4f95-bdaf-7652ad9a16e6 admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:12.280102 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-098de49a-3e7c-4f95-bdaf-7652ad9a16e6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 May 16 20:30:12.280655 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Mon May 16 20:30:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:30:12.470719 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-c5433a6a-0feb-4db3-ad32-74fd34f4a819 admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:12.477542 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.wsgi [None req-c5433a6a-0feb-4db3-ad32-74fd34f4a819 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-c5433a6a-0feb-4db3-ad32-74fd34f4a819 admin admin] Request method failure captured: May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Accept: application/json May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Accept-Encoding: gzip, deflate May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Connection: keep-alive May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Content-Length: 0 May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Host: 10.222.0.49 May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Openstack-Api-Version: compute 2.90 May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Openstack-System-Scope: None May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: User-Agent: python-novaclient May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Auth-Token: gAAAAABigrRU8pwg54BmvBlNQSNuCgqrUhFAKbG5MU27u3xGwBs8IB1sTyRrpctozmvlUZWMRo7u1_zoReLSHe6MW_MBLep2ooscScDASmaYFPAHMDQIhMjkeM7r2hwfJsBpY1UJPCw4NuO_uA3G1dIMl7nFIdP4AX_QBXhei6bSvJHvLVnKW8Q May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Domain-Id: None May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Domain-Name: None May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Identity-Status: Confirmed May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Is-Admin-Project: True May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Openstack-Nova-Api-Version: 2.90 May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Project-Domain-Id: default May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Project-Domain-Name: Default May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Project-Id: cd0e31e92b6648feab627c19ac9bf98d May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Project-Name: admin May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Role: reader,member,admin May 16 20:30:12.479353 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Roles: reader,member,admin May 16 20:30:12.481006 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cd0e31e92b6648feab627c19ac9bf98d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd0e31e92b6648feab627c19ac9bf98d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cd0e31e92b6648feab627c19ac9bf98d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd0e31e92b6648feab627c19ac9bf98d"}]}] May 16 20:30:12.481006 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Tenant: admin May 16 20:30:12.481006 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Tenant-Id: cd0e31e92b6648feab627c19ac9bf98d May 16 20:30:12.481006 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-Tenant-Name: admin May 16 20:30:12.481006 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-User: admin May 16 20:30:12.481006 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-User-Domain-Id: default May 16 20:30:12.481006 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-User-Domain-Name: Default May 16 20:30:12.481006 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-User-Id: fc0c07a955fe4edc868e35eb1b8525a2 May 16 20:30:12.481006 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: X-User-Name: admin May 16 20:30:12.481006 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: method: > May 16 20:30:12.481006 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: exception: Flavor 451 could not be found. May 16 20:30:12.481006 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: action_args: {'id': '451'} May 16 20:30:12.481006 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:30:12.481006 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:30:12.481822 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 20:30:12.481822 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 20:30:12.481822 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 20:30:12.481822 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 20:30:12.481822 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 20:30:12.481822 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 20:30:12.481822 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 20:30:12.481822 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 20:30:12.481822 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 20:30:12.481822 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:30:12.481822 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 20:30:12.481822 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 20:30:12.481822 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 16 20:30:12.481822 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi May 16 20:30:12.481822 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:30:12.481822 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi May 16 20:30:12.481822 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:30:12.481822 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:30:12.481822 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:30:12.483588 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:30:12.483588 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:30:12.483588 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:30:12.483588 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:30:12.483588 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 20:30:12.483588 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 20:30:12.483588 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 16 20:30:12.483588 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi May 16 20:30:12.483588 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:30:12.483588 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi May 16 20:30:12.483588 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:30:12.483588 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:30:12.483588 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:30:12.483588 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:30:12.483588 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:30:12.483588 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 16 20:30:12.483588 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: ERROR nova.api.openstack.wsgi May 16 20:30:12.483588 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-c5433a6a-0feb-4db3-ad32-74fd34f4a819 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:30:12.492559 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-c5433a6a-0feb-4db3-ad32-74fd34f4a819 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060830 May 16 20:30:12.492559 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Mon May 16 20:30:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 20:30:12.492777 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-99d69ae1-ce8d-43d3-a453-abbc71c90a1b admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:12.505365 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-99d69ae1-ce8d-43d3-a453-abbc71c90a1b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018213 May 16 20:30:12.505891 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Mon May 16 20:30:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:30:12.515442 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-8a74192b-f4d6-45a6-9741-09f78b1ce497 admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:12.529788 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-8a74192b-f4d6-45a6-9741-09f78b1ce497 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017972 May 16 20:30:12.530349 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Mon May 16 20:30:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:30:12.540133 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-2f792868-bd03-4834-a5fa-15b505e292bf admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:12.545893 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.wsgi [None req-2f792868-bd03-4834-a5fa-15b505e292bf admin admin] HTTP exception thrown: Flavor 451 could not be found. May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-2f792868-bd03-4834-a5fa-15b505e292bf admin admin] Request method failure captured: May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Accept: application/json May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Accept-Encoding: gzip, deflate May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Connection: keep-alive May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Content-Length: 0 May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Host: 10.222.0.49 May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Openstack-Api-Version: compute 2.90 May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Openstack-System-Scope: None May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: User-Agent: python-novaclient May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Auth-Token: gAAAAABigrRU8pwg54BmvBlNQSNuCgqrUhFAKbG5MU27u3xGwBs8IB1sTyRrpctozmvlUZWMRo7u1_zoReLSHe6MW_MBLep2ooscScDASmaYFPAHMDQIhMjkeM7r2hwfJsBpY1UJPCw4NuO_uA3G1dIMl7nFIdP4AX_QBXhei6bSvJHvLVnKW8Q May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Domain-Id: None May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Domain-Name: None May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Identity-Status: Confirmed May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Is-Admin-Project: True May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Openstack-Nova-Api-Version: 2.90 May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Project-Domain-Id: default May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Project-Domain-Name: Default May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Project-Id: cd0e31e92b6648feab627c19ac9bf98d May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Project-Name: admin May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Role: reader,member,admin May 16 20:30:12.547388 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Roles: reader,member,admin May 16 20:30:12.548830 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cd0e31e92b6648feab627c19ac9bf98d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd0e31e92b6648feab627c19ac9bf98d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cd0e31e92b6648feab627c19ac9bf98d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd0e31e92b6648feab627c19ac9bf98d"}]}] May 16 20:30:12.548830 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Tenant: admin May 16 20:30:12.548830 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Tenant-Id: cd0e31e92b6648feab627c19ac9bf98d May 16 20:30:12.548830 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-Tenant-Name: admin May 16 20:30:12.548830 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-User: admin May 16 20:30:12.548830 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-User-Domain-Id: default May 16 20:30:12.548830 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-User-Domain-Name: Default May 16 20:30:12.548830 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-User-Id: fc0c07a955fe4edc868e35eb1b8525a2 May 16 20:30:12.548830 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: X-User-Name: admin May 16 20:30:12.548830 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: method: > May 16 20:30:12.548830 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: exception: Flavor 451 could not be found. May 16 20:30:12.548830 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: action_args: {'id': '451'} May 16 20:30:12.548830 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:30:12.548830 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:30:12.549640 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 20:30:12.549640 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 20:30:12.549640 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 20:30:12.549640 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 20:30:12.549640 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 20:30:12.549640 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 20:30:12.549640 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 20:30:12.549640 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 20:30:12.549640 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 20:30:12.549640 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:30:12.549640 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 20:30:12.549640 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 20:30:12.549640 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 16 20:30:12.549640 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi May 16 20:30:12.549640 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:30:12.549640 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi May 16 20:30:12.549640 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:30:12.549640 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:30:12.549640 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:30:12.550715 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:30:12.550715 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:30:12.550715 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:30:12.550715 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:30:12.550715 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 20:30:12.550715 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 20:30:12.550715 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 16 20:30:12.550715 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi May 16 20:30:12.550715 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:30:12.550715 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi May 16 20:30:12.550715 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:30:12.550715 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:30:12.550715 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:30:12.550715 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:30:12.550715 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:30:12.550715 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 16 20:30:12.550715 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: ERROR nova.api.openstack.wsgi May 16 20:30:12.550715 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-2f792868-bd03-4834-a5fa-15b505e292bf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:30:12.551770 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-2f792868-bd03-4834-a5fa-15b505e292bf admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012219 May 16 20:30:12.551770 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Mon May 16 20:30:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 20:30:13.436547 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-8a74192b-f4d6-45a6-9741-09f78b1ce497 admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:13.437569 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-8a74192b-f4d6-45a6-9741-09f78b1ce497 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 May 16 20:30:13.437969 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Mon May 16 20:30:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:30:13.625609 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-f01d7c8d-42df-4343-aab3-eaebfe3bcfba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:30:13.653485 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-f01d7c8d-42df-4343-aab3-eaebfe3bcfba admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.081028 May 16 20:30:13.654081 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Mon May 16 20:30:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 20:30:14.541484 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-8a74192b-f4d6-45a6-9741-09f78b1ce497 admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:14.542487 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-8a74192b-f4d6-45a6-9741-09f78b1ce497 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 May 16 20:30:14.542881 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Mon May 16 20:30:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:30:14.737312 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-25a181ad-0fae-4cbf-91bc-163b9d24e3e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:30:14.756640 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-25a181ad-0fae-4cbf-91bc-163b9d24e3e2 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.076494 May 16 20:30:14.757127 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Mon May 16 20:30:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 20:30:15.643729 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-8a74192b-f4d6-45a6-9741-09f78b1ce497 admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:15.644742 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-8a74192b-f4d6-45a6-9741-09f78b1ce497 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 16 20:30:15.645150 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Mon May 16 20:30:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:30:15.836425 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-34f9aa17-e226-46bc-946b-60fe9703fec6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:30:15.856492 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-34f9aa17-e226-46bc-946b-60fe9703fec6 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.074021 May 16 20:30:15.857044 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Mon May 16 20:30:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 20:30:16.763421 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-8a74192b-f4d6-45a6-9741-09f78b1ce497 admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:16.764459 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-8a74192b-f4d6-45a6-9741-09f78b1ce497 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 16 20:30:16.764866 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Mon May 16 20:30:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:30:16.960931 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-5b826a5c-96c0-4c24-b163-42ead3def48e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:30:16.982598 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-5b826a5c-96c0-4c24-b163-42ead3def48e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.083343 May 16 20:30:16.983184 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Mon May 16 20:30:16 2022] POST /compute/v2.1/flavors => generated 409 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 20:30:17.883529 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-8a74192b-f4d6-45a6-9741-09f78b1ce497 admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:17.884644 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-8a74192b-f4d6-45a6-9741-09f78b1ce497 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 16 20:30:17.885037 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Mon May 16 20:30:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:30:18.080489 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-58f27784-9a1c-4eac-9883-75257ecd3f8f admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:30:18.099893 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-58f27784-9a1c-4eac-9883-75257ecd3f8f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.080508 May 16 20:30:18.100362 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Mon May 16 20:30:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:31:19.788273 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-8a74192b-f4d6-45a6-9741-09f78b1ce497 admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:31:19.789274 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-8a74192b-f4d6-45a6-9741-09f78b1ce497 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 May 16 20:31:19.789670 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 930 bytes} [Mon May 16 20:31:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:31:19.851360 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-4228c43c-a2bc-4c20-940d-68a80aa9c72a admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:31:19.870966 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-4228c43c-a2bc-4c20-940d-68a80aa9c72a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075206 May 16 20:31:19.871503 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1291 bytes} [Mon May 16 20:31:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:31:19.893671 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-8ca1fea2-2257-4119-aec6-fd8cdea35d94 admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:31:19.901423 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-8ca1fea2-2257-4119-aec6-fd8cdea35d94 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011978 May 16 20:31:19.901933 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1282 bytes} [Mon May 16 20:31:19 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:31:19.912916 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-80c9c7b2-3069-48f8-96a7-9756ee67808a admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:31:19.920863 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-80c9c7b2-3069-48f8-96a7-9756ee67808a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011434 May 16 20:31:19.921357 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1285 bytes} [Mon May 16 20:31:19 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:31:19.932391 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-78ddd103-49d5-4dba-934f-a184752a0436 admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:31:19.939874 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-78ddd103-49d5-4dba-934f-a184752a0436 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010861 May 16 20:31:19.940365 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1285 bytes} [Mon May 16 20:31:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:31:19.953280 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-babfb9e3-ff8a-4da1-81ac-5863888425d4 admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:31:19.961066 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-babfb9e3-ff8a-4da1-81ac-5863888425d4 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011197 May 16 20:31:19.961671 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1282 bytes} [Mon May 16 20:31:19 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:34:49.261138 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-78ddd103-49d5-4dba-934f-a184752a0436 admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:34:49.262147 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-78ddd103-49d5-4dba-934f-a184752a0436 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 May 16 20:34:49.262541 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Mon May 16 20:34:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:34:49.545682 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-ddf17a9f-3007-435f-a887-d7491bc56235 admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:34:49.546852 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 20:34:49.546852 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: warnings.warn(msg) May 16 20:34:49.548066 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_concurrency.lockutils [None req-ddf17a9f-3007-435f-a887-d7491bc56235 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:34:49.548488 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_concurrency.lockutils [None req-ddf17a9f-3007-435f-a887-d7491bc56235 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:34:49.549311 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_concurrency.lockutils [None req-ddf17a9f-3007-435f-a887-d7491bc56235 admin admin] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:34:49.549726 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_concurrency.lockutils [None req-ddf17a9f-3007-435f-a887-d7491bc56235 admin admin] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:34:49.583081 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-ddf17a9f-3007-435f-a887-d7491bc56235 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.163324 May 16 20:34:49.583658 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Mon May 16 20:34:49 2022] GET /compute/v2.1/os-services => generated 794 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 20:34:50.482573 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-78ddd103-49d5-4dba-934f-a184752a0436 admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:34:50.483698 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-78ddd103-49d5-4dba-934f-a184752a0436 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 16 20:34:50.484262 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Mon May 16 20:34:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:34:50.676129 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-e6350c25-afe0-408b-b2c7-5e19628ab09d admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:34:50.677330 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 20:34:50.677330 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: warnings.warn(msg) May 16 20:34:50.678518 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_concurrency.lockutils [None req-e6350c25-afe0-408b-b2c7-5e19628ab09d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:34:50.678953 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_concurrency.lockutils [None req-e6350c25-afe0-408b-b2c7-5e19628ab09d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:34:50.679747 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_concurrency.lockutils [None req-e6350c25-afe0-408b-b2c7-5e19628ab09d admin admin] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:34:50.680165 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_concurrency.lockutils [None req-e6350c25-afe0-408b-b2c7-5e19628ab09d admin admin] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:34:50.699061 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-e6350c25-afe0-408b-b2c7-5e19628ab09d admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076779 May 16 20:34:50.699620 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Mon May 16 20:34:50 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 20:35:02.059751 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-78ddd103-49d5-4dba-934f-a184752a0436 admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:35:02.060803 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-78ddd103-49d5-4dba-934f-a184752a0436 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 16 20:35:02.061200 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1074 bytes} [Mon May 16 20:35:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:35:02.270056 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-6add83a9-2aa7-4241-8147-855557c109b8 admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:35:02.271327 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 20:35:02.271327 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: warnings.warn(msg) May 16 20:35:02.272607 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_concurrency.lockutils [None req-6add83a9-2aa7-4241-8147-855557c109b8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:35:02.273045 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_concurrency.lockutils [None req-6add83a9-2aa7-4241-8147-855557c109b8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:35:02.273860 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_concurrency.lockutils [None req-6add83a9-2aa7-4241-8147-855557c109b8 admin admin] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:35:02.274283 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_concurrency.lockutils [None req-6add83a9-2aa7-4241-8147-855557c109b8 admin admin] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:35:02.298779 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-6add83a9-2aa7-4241-8147-855557c109b8 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.094562 May 16 20:35:02.299321 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 38/74] 10.222.0.49 () {60 vars in 1193 bytes} [Mon May 16 20:35:02 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:35:03.208308 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: DEBUG nova.api.openstack.wsgi [None req-78ddd103-49d5-4dba-934f-a184752a0436 admin admin] Calling method '>' {{(pid=102756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:35:03.209496 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: INFO nova.api.openstack.requestlog [None req-78ddd103-49d5-4dba-934f-a184752a0436 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 May 16 20:35:03.209896 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: [pid: 102756|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1074 bytes} [Mon May 16 20:35:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:35:03.417795 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG nova.api.openstack.wsgi [None req-ae994d1b-300b-4294-9651-1e4926e1164a admin admin] Calling method '>' {{(pid=102757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:35:03.418993 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 20:35:03.418993 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: warnings.warn(msg) May 16 20:35:03.420186 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_concurrency.lockutils [None req-ae994d1b-300b-4294-9651-1e4926e1164a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:35:03.420660 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_concurrency.lockutils [None req-ae994d1b-300b-4294-9651-1e4926e1164a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:35:03.421460 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_concurrency.lockutils [None req-ae994d1b-300b-4294-9651-1e4926e1164a admin admin] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:35:03.421887 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: DEBUG oslo_concurrency.lockutils [None req-ae994d1b-300b-4294-9651-1e4926e1164a admin admin] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:35:03.443767 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: INFO nova.api.openstack.requestlog [None req-ae994d1b-300b-4294-9651-1e4926e1164a admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.091961 May 16 20:35:03.444332 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: [pid: 102757|app: 0|req: 39/76] 10.222.0.49 () {60 vars in 1193 bytes} [Mon May 16 20:35:03 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:35:59.186182 dv-cinder-777031-16-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 16 20:35:59.186915 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: Mon May 16 20:35:59 2022 - graceful shutdown triggered... May 16 20:35:59.187391 dv-cinder-777031-16-iscsi devstack@n-api.service[102756]: Gracefully killing worker 1 (pid: 102756)... May 16 20:35:59.187939 dv-cinder-777031-16-iscsi devstack@n-api.service[102757]: Gracefully killing worker 2 (pid: 102757)... May 16 20:36:00.187201 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: worker 1 buried after 1 seconds May 16 20:36:00.187201 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: worker 2 buried after 1 seconds May 16 20:36:00.187201 dv-cinder-777031-16-iscsi devstack@n-api.service[102755]: goodbye to uWSGI. May 16 20:36:00.189696 dv-cinder-777031-16-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 16 20:36:00.190607 dv-cinder-777031-16-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 16 20:36:00.194916 dv-cinder-777031-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 16 20:36:00.215702 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 16 20:36:00.236630 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 20:36:00 2022] *** May 16 20:36:00.236630 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 20:36:00.236630 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 20:36:00.236630 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: nodename: dv-cinder-777031-16-iscsi May 16 20:36:00.236630 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: machine: x86_64 May 16 20:36:00.236630 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: clock source: unix May 16 20:36:00.236630 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: pcre jit disabled May 16 20:36:00.236630 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: detected number of CPU cores: 4 May 16 20:36:00.236630 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: current working directory: / May 16 20:36:00.236630 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: detected binary path: /usr/bin/uwsgi-core May 16 20:36:00.236630 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: your processes number limit is 47680 May 16 20:36:00.236630 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: your memory page size is 4096 bytes May 16 20:36:00.236630 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: detected max file descriptor number: 2048 May 16 20:36:00.237673 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: lock engine: pthread robust mutexes May 16 20:36:00.237673 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: thunder lock: enabled May 16 20:36:00.237673 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 16 20:36:00.238702 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 20:36:00.283627 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: Python main interpreter initialized at 0x55bc184d69c0 May 16 20:36:00.283627 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: python threads support enabled May 16 20:36:00.283627 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: your server socket listen backlog is limited to 100 connections May 16 20:36:00.283627 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: your mercy for graceful operations on workers is 90 seconds May 16 20:36:00.284054 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: mapped 403077 bytes (393 KB) for 2 cores May 16 20:36:00.284054 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: *** Operational MODE: preforking *** May 16 20:36:00.284323 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: *** uWSGI is running in multiple interpreter mode *** May 16 20:36:00.284323 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: spawned uWSGI master process (pid: 123547) May 16 20:36:00.284579 dv-cinder-777031-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 16 20:36:00.285825 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: spawned uWSGI worker 1 (pid: 123563, cores: 1) May 16 20:36:00.285825 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: spawned uWSGI worker 2 (pid: 123564, cores: 1) May 16 20:36:00.285825 dv-cinder-777031-16-iscsi devstack@n-api.service[123547]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 20:36:01.483121 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 20:36:01.483787 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 20:36:02.275552 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 20:36:02.275552 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: from cryptography.utils import int_from_bytes May 16 20:36:02.275881 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 20:36:02.275881 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: from cryptography.utils import int_from_bytes May 16 20:36:02.275881 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 20:36:02.275881 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: from cryptography.utils import int_from_bytes May 16 20:36:02.276142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 20:36:02.276142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: from cryptography.utils import int_from_bytes May 16 20:36:04.677874 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 20:36:04.678567 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 20:36:04.678680 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 20:36:04.678776 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 20:36:04.679131 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 20:36:04.679218 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 20:36:04.679218 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 20:36:04.679485 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 20:36:04.679633 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.679853 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 20:36:04.679991 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.680114 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 20:36:04.680275 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.680519 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.680627 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.680813 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.680994 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.681170 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.681322 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.681491 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.681629 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.681853 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.682067 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.682218 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.682399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.682537 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.682711 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.682860 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.683037 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.683188 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.683370 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-777031-16-iscsi {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.683524 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.683694 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.683810 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.684004 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.684113 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-777031-16-iscsi {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.684324 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.684428 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.684665 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.684762 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.684981 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.685094 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.685305 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.685407 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.685615 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.685718 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.685942 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.686117 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.686230 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.686574 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.686747 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.686878 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.687044 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.687197 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.687375 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.687557 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.688489 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.688611 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.688694 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.688773 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.688846 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.688923 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.689002 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.689085 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.689159 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.689239 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.689320 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.690367 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.690508 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.690642 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-777031-16-iscsi {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.690766 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.690876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.690976 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-777031-16-iscsi {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.691084 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.691181 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.691273 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.691365 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.691365 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.691587 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.691587 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.691845 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.691981 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.692116 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.692244 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.692382 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.692631 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.692760 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.692888 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.693020 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.693145 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.693286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.693412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.693539 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.693664 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.693790 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.696457 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.696635 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.696789 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.696939 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.697080 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.697210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.697347 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.697503 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.697641 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.697775 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.697901 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.698035 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.698172 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.698334 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.698483 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.698637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.698802 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.698972 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.699126 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.699268 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.699416 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.699560 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.699708 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.700043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.700205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.700205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.700205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.700205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.700810 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.700810 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.701102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.701250 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.701394 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.701546 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.701698 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.701847 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.703195 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.703359 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.703505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.703661 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.703823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.703973 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.704165 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.704328 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.704488 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.704643 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.704812 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.704909 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.704992 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.705065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.705157 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.705250 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.705360 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.705453 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.705545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.705637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.705637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.705814 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.705814 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.705981 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.706073 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.706157 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.706248 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.706349 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.706442 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.706528 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.706617 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.706617 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.706617 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.706868 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.706960 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.707056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.707149 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.707239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.707330 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.707434 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.707519 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.707614 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.707698 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.707792 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.707897 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.707897 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.708068 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.708152 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.708242 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.708331 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.708428 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.708630 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.708705 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.708777 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.708986 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.709115 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.709318 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.709430 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.709628 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.709813 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.709942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.710140 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.710430 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.710538 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.710751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.710848 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.711071 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.711167 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.711389 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.711493 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.711704 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.711799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.712014 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.712194 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.712351 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.712523 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.712670 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.712808 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.712954 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.713219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.713365 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.713503 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.713649 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.713784 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.713926 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.714071 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.714243 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.714390 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.714554 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.714700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.714865 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.715009 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.715168 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.715304 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.715483 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.715628 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.715810 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.715958 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.716122 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.716276 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.716463 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.716632 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.716785 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.716931 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.717076 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.717209 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.717367 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.717461 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.717681 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.717781 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.717995 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.718093 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.718313 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.718427 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.718622 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.718721 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.718935 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.719037 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.719249 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.719426 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.719583 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.719949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.719949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.720267 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.720415 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.720633 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.720782 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.720873 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.720968 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.721060 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.721146 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.721240 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.721358 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.721450 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.721685 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.721787 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.721994 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.722100 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.722305 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.722407 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.722615 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.722706 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.722923 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.723023 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.723230 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.723328 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.723538 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.723630 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.723862 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.723967 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.724190 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.724280 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.724526 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.724622 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.724842 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.724935 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.725152 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.725251 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.725477 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:36:04.725569 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.725818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.725911 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.726155 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.726248 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.726499 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.726597 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.726818 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.726912 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.727138 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.727238 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.727457 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.727559 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.727782 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.727883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.728099 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.728189 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.728502 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.728619 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.728798 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.728892 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.729123 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.729213 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.729444 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.729551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.729759 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.729941 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.730141 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.730299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.730390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.730482 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.730723 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.730857 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.731031 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.731121 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.731354 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.731445 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.731679 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.731771 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.731997 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.732097 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.732324 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.732423 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.732680 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.732779 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.732999 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.733099 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.733314 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.733420 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.733630 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.733722 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.733959 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.734058 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.734299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.734403 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.734617 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.734716 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.734941 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.735039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.735257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.735359 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.735572 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.735668 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.735888 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.735981 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.736205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.736311 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.736544 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.736652 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.736889 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.736988 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.737214 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.737308 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.737538 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.737629 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.737853 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.737995 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.738170 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.738263 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.738484 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.738595 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.738804 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.738904 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.739113 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.739215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.739423 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.739522 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.739732 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.739824 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.740044 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.740150 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.740361 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.740477 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.740700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.740808 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.741018 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.741116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.741332 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.741432 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.741640 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.741745 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.741949 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.742041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.742259 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.742351 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.742573 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.742679 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.742881 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.742974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.743194 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.743285 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.743506 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.743612 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.743819 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.743910 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.744132 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.744221 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.744519 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.744638 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.744837 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.744928 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.745152 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.745243 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.745461 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.745560 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.745769 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.745859 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.746087 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.746186 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.746393 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.746492 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.746701 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.746799 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.747015 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.747112 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.747330 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.747429 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.747638 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.747730 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.747954 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.748048 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.748267 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.748368 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.748617 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.748721 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.748937 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.749052 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.749250 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.749342 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.749567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.749666 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.749888 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.749993 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.750207 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.750308 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.750535 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.750630 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.750853 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.750955 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.751163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.751253 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.751479 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.751570 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.751789 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.751883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.752100 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.752192 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.752410 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.752604 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.752748 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.752841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.753071 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.753163 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.753380 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.753479 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.753691 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.753791 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.754000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.754099 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.754311 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.754403 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.754623 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.754721 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.754938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.755030 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.755246 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.755347 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.755552 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.755650 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.755861 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.755959 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.756168 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.756269 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.756506 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.756601 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.756837 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.756931 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.757152 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.757330 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.757463 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.757555 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.757772 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.757864 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.758080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.758181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.758427 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.758528 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.758735 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.758826 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.759051 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.759150 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.759371 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.759462 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.759691 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.759783 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.760050 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.760151 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.760366 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.760574 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.760714 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.760814 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.761055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.761159 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.761319 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.761402 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.761639 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.761770 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.761952 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.762082 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.762333 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.762560 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.762741 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.762885 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.763017 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.763212 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.763357 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.763525 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.763684 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.763857 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.764016 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.764266 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.764359 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.764510 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.764670 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.764824 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.764986 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.765148 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.765302 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.765494 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.765620 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.765834 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.765935 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.766155 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.766254 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.766483 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.766584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.766798 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.766893 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.767115 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.767206 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.767428 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.767519 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.767741 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.767834 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.768053 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.768144 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.768369 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.768511 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.768715 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.768815 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.769039 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.769177 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.769362 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.769462 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.769676 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.769768 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.769995 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.770094 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.770305 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.770444 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.770629 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.770767 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.770937 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.771047 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.771250 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.771419 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.771560 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.771693 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.771872 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.771964 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.772186 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.772279 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.772527 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.772620 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.772843 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.772933 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.773158 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.773252 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.773475 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.773566 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.773783 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.773874 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.774091 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.774182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.774399 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.774497 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.774703 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.774793 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.775017 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.775110 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.775331 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.775429 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.775695 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.775838 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.776008 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.776110 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.776326 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.776417 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.776660 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.776766 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.776965 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.777057 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.777272 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.777363 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.777587 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.777692 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.777895 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.777992 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.778204 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.778295 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.778514 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.778619 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.778840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.778945 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.779149 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.779283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.779456 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.779556 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.779775 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.779873 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.780085 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.780184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.780395 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.780566 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.780830 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.780935 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.781022 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.781106 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.781337 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.781429 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.781662 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.781755 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.781968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.782068 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.782280 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.782371 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.782594 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.782685 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.782906 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.783004 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.783219 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.783309 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.783532 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.783622 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.783846 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.783950 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.784158 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.784249 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.784498 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.784604 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.784815 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.784916 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.785124 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.785226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.785439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.785529 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.785753 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.785858 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.786069 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.786344 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.786436 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.786687 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.786862 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.786998 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.787089 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.787311 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.787439 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.787617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.787719 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.787931 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.788023 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.788251 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.788356 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.788614 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.788877 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.788977 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.789218 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.789323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.789538 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.789638 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.789859 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.789950 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.790175 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.790274 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.790492 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.790593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.790812 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.790944 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.791124 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.791251 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.791459 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.791552 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.791775 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.791885 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.792088 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.792194 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.792401 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.792546 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.793098 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.793203 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.793409 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.793509 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.793720 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.793812 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.794028 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.794120 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.794335 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.794433 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.794646 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.794745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.794952 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.795044 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.795260 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.795360 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.795567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.795672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.795876 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.795970 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.796185 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.796282 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.796509 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.796622 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.796830 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.796924 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.797137 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.797239 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.797463 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.797564 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.797776 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.797868 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.798086 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.798185 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.798394 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.798501 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.798702 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.798795 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.799054 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.799147 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.799363 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.799504 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.799673 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.799765 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.799987 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.800080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.800300 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.800401 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.800635 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.800764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.800953 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.801099 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.801269 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.801372 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.801577 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.801669 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.801887 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.801989 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.802195 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.802287 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.802505 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.802595 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.802811 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.802916 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.803114 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.803237 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.803429 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.803529 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.803735 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.803839 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.804045 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.804137 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.804358 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.804478 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.804691 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.804794 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.804998 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.805090 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.805305 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.805403 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.805616 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.805720 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.805927 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.806059 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.806233 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.806327 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.806540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.806640 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.806925 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.807019 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.807243 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.807334 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.807547 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.807639 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.807854 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.807946 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.808163 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.808254 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.808504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.808600 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.808819 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.808912 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.809128 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.809225 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.809439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.809568 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.809747 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.809838 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.810058 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.810158 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.810366 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.810458 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.810692 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.810783 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.811008 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.811153 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.811316 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.811409 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.811621 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.811714 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.811930 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.812034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.812235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.812334 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.812565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.812670 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.812879 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.812978 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.813184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.813283 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.813492 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.813584 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.813810 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.813912 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.814110 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.814203 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.814419 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.814517 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.814728 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.814822 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.815038 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.815130 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.815345 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.815436 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.815651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.815745 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.815957 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.816110 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.816260 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.816375 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.816603 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.816696 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.816884 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.816977 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.817211 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.817321 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.817523 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.817618 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.817831 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.817924 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.818138 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.818239 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.818442 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.818543 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.818793 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.818893 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.819102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.819207 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.819424 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.819523 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.819738 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.819831 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.820056 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.820158 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.820363 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.820505 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.820699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.820800 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.821014 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.821320 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.821320 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.821546 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.821637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.821721 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.821936 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.822030 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.822251 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.822344 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.822593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.822695 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.822901 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.823001 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.823210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.823310 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.823523 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.823620 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.823836 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.823931 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.824156 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.824255 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.824476 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.824583 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.824794 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.824887 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.825114 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.825206 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.825420 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.825524 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.825732 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.825824 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.826046 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.826145 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.826355 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.826456 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.826666 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.826764 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.826976 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.827068 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.827283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.827384 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.827596 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.827687 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.827910 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.828010 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.828215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.828306 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.828550 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.828645 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.828863 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.828968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.829176 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.829268 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.829487 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.829578 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.829792 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.829925 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.830122 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.830243 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.830433 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.830563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.830739 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.830872 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.831051 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.831187 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.831358 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.831490 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.831673 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.831811 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.831981 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.832129 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.832414 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.832557 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.832752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.832860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.833067 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.833167 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.833378 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.833480 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.833690 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.833800 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.834004 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.834104 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.834324 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.834417 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.834641 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.834743 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.834948 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.835041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.835266 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.835365 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.835581 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.835674 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.835888 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.835988 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.836214 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.836313 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.836553 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.836650 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.836877 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.836969 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.837190 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.837282 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.837517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.837636 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.837826 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.837929 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.838185 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.838353 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.838496 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.838669 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.838827 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.838982 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.839134 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.839310 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.839458 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.839635 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.839880 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.840006 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.840192 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.840294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.840521 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.840627 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.840884 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.840981 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.841213 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.841319 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.841543 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.841653 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.841859 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.841969 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.842176 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.842269 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.842486 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.842584 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.842792 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.842892 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.843109 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.843215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.843427 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.843556 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.843751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.843852 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.844075 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.844174 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.844390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.844522 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.844731 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.844842 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.845039 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.845133 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.845367 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.845459 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.845693 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.845788 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.846011 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.846104 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.846336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.846427 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.846648 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.846749 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.846960 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.847052 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.847293 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.847386 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.847607 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.847700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.847923 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.848023 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.848240 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.848346 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.848575 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.848682 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.848885 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.848978 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.849194 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.849297 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.849501 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.849602 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.849816 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.849906 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.850125 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.850233 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.850440 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.850541 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.850756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.850856 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.851066 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.851171 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.851374 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.851477 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.851682 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.851775 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.851999 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.852103 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.852302 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.852400 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.852636 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.852739 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.852945 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.853045 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.853267 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.853360 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.853590 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.853710 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.853923 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.854023 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.854248 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.854348 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.854560 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.854654 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.854870 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.854969 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.855178 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.855277 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.855484 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.855586 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.855830 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.855924 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.856138 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.856238 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.856486 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.856602 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.856791 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.856883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.857105 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.857196 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.857419 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.857520 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.857733 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.857825 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.858044 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.858136 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.858355 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.858457 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.858669 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.858761 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.858978 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.859071 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.859289 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.859383 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.859595 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.859687 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.859909 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.860010 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.860217 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.860320 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.860546 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.860659 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.860853 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.860953 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.861163 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.861256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.861473 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.861571 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.861779 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.861870 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.862085 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.862188 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.862408 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.862501 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.862716 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.862816 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.863040 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.863140 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.863350 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.863449 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.863658 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.863763 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.863965 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.864058 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.864271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.864407 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.864637 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.864740 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.864960 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.865060 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.865282 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.865375 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.865611 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.865716 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.865932 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.866024 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.866251 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.866377 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.866570 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.866695 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.866889 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.867025 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.867190 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.867284 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.867508 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.867607 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.867828 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.867920 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.868145 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.868356 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.868496 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.868724 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.868817 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.869045 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.869137 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.869447 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.869554 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.869770 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.869919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.870090 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.870231 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.870409 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.870554 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.870872 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.870977 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.871192 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.871291 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.871515 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.871648 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.871831 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.871928 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.872157 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.872254 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.872494 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.872602 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.872812 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.872911 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.873125 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.873225 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.873440 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.873535 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.873756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.873885 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.874068 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.874176 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.874393 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.874492 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.874714 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.874806 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.875042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.875240 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.875367 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.875466 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.875681 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.875773 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.875998 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.876092 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.876314 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.876419 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.876655 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.876749 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.876973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.877065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.877293 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.877384 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.877612 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.877718 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.877931 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.878023 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.878246 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.878337 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.878563 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.878664 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.878878 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.878978 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.879191 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.879291 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.879510 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.879615 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.879825 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.879926 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.880141 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.880243 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.880480 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.880577 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.880808 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.880947 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.881104 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.881314 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.881417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.881635 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.881757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.881976 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.882077 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.882309 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.882416 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.882640 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.882741 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.882967 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.883060 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.883296 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.883500 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.883633 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.883818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.883950 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.884155 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.884259 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.884507 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.884603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.884838 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.884951 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.885185 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.885298 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.885510 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.885632 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.885845 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.885937 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.886155 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.886257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.886466 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.886565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.886782 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.886875 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.887096 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.887395 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.887523 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.887717 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.887816 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.888031 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.888127 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.888337 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.888459 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.888685 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.888789 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.889004 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.889110 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.889347 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.889543 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.889679 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.889898 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.889992 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.890221 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.890314 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.890551 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.890686 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.890879 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.890981 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.891200 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.891297 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.891506 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.891598 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.891822 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.891930 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.892130 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.892228 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.892473 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.892582 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.892774 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.892880 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.893086 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.893178 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.893395 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.893495 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.893706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.893813 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.894017 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.894150 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.894327 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.894426 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.894637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.894732 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.894947 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.895038 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.895252 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.895350 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.895563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.895662 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.895876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.895975 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.896183 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.896281 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.896511 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.896607 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.896829 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.896930 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.897138 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.897230 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.897446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.897538 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.897753 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.897850 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.898056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.898157 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.898371 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.898471 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.898681 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.898774 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.899000 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.899102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.899305 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.899397 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.899617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.899710 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.899923 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.900024 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.900236 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.900335 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.900650 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.900756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.900980 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.901086 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.901303 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.901396 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.901610 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.901709 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.901928 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.902174 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.902275 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.902521 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.902621 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.902853 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.902953 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.903168 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.903260 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.903518 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.903618 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.903832 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.903932 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.904147 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.904367 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.904512 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.904736 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.904840 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.905068 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.905163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.905417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.905516 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.905742 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.905842 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.906055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.906155 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.906370 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.906469 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.906684 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.906784 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.907000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.907115 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.907322 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.907439 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.907636 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.907742 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.907947 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.908056 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.908263 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.908363 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.908645 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.908755 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.908919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.909012 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.909232 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.909323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.909546 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.909648 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.909861 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.909953 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.910174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.910267 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.910487 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.910581 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.910803 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.910938 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.911118 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.911217 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.911434 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.911528 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.911751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.911845 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.912075 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.912212 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.912390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.912504 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.912733 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.912829 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.913049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.913155 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.913365 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.913459 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.913678 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.913778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.913991 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.914097 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.914308 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.914450 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.914641 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.914744 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.914956 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.915057 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.915264 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.915358 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.915643 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.915742 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.915969 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.916069 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.916313 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.916416 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.916664 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.916767 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.916978 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.917086 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.917304 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.917396 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.917628 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.918088 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.918299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.918390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.918612 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.918709 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.918922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.919034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.919239 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.919332 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.919564 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.919664 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.919882 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.919988 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.920192 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.920284 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.920534 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.920632 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.920845 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.920938 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.921154 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.921248 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.921464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.921565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.921775 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.921869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.922084 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.922217 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.922388 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.922483 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.922694 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.922794 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.923002 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.923102 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.923308 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.923399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.923614 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.923706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.923916 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.924007 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.924222 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.924324 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.924556 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.924684 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.924866 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.924960 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.925172 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.925273 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.925477 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.925569 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.925781 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.925874 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.926088 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.926193 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.926392 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.926484 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.926706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.926799 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.927015 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.927117 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.927322 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.927455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.927628 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.927738 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.927935 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.928030 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.928239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.928340 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.928601 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.928696 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.928946 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.929047 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.929264 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.929363 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.929582 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.929674 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.929897 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.929997 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.930221 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.930313 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.930537 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.930628 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.930858 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.930950 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.931177 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.931271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.931493 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.931593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.931805 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.931975 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.932174 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.932406 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.932559 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.932751 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.932851 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.933072 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.933173 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.933392 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.933485 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.933708 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.933802 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.934022 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.934122 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.934338 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.934517 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.934657 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.934792 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.934992 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.935087 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.935310 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.935414 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.935626 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.935716 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.935943 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.936043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.936262 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.936367 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.936600 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.936706 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.936917 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.937016 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.937258 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.937358 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.937569 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.937669 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.937879 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.937977 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.938195 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.938296 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.938510 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.938605 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.938831 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.938931 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.939153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.939255 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.939471 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.939565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.939802 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.939895 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.940134 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.940227 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.940478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.940586 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.940778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.940885 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.941011 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 20:36:04.941113 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.941445 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.941763 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.942114 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.942474 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.942761 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.943075 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.943383 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:36:04.943627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 20:36:04.964870 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_db.sqlalchemy.engines [None req-1f0f5b2e-97de-4b88-849d-46630d1dfcfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 20:36:04.966542 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_db.sqlalchemy.engines [None req-17550c03-96bf-4052-8607-e5d41daa41f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 20:36:05.029609 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.context [None req-17550c03-96bf-4052-8607-e5d41daa41f9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1402e959-c99d-408c-abcd-23ab2c728bba(cell1) {{(pid=123563) load_cells /opt/stack/nova/nova/context.py:464}} May 16 20:36:05.031585 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.context [None req-1f0f5b2e-97de-4b88-849d-46630d1dfcfb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1402e959-c99d-408c-abcd-23ab2c728bba(cell1) {{(pid=123564) load_cells /opt/stack/nova/nova/context.py:464}} May 16 20:36:05.034050 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-17550c03-96bf-4052-8607-e5d41daa41f9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:36:05.035630 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-17550c03-96bf-4052-8607-e5d41daa41f9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:36:05.036124 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1f0f5b2e-97de-4b88-849d-46630d1dfcfb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:36:05.036461 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-17550c03-96bf-4052-8607-e5d41daa41f9 None None] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:36:05.037739 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1f0f5b2e-97de-4b88-849d-46630d1dfcfb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:36:05.038442 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-17550c03-96bf-4052-8607-e5d41daa41f9 None None] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:36:05.038556 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1f0f5b2e-97de-4b88-849d-46630d1dfcfb None None] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:36:05.040537 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1f0f5b2e-97de-4b88-849d-46630d1dfcfb None None] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:36:05.050549 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_db.sqlalchemy.engines [None req-17550c03-96bf-4052-8607-e5d41daa41f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 20:36:05.051873 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_db.sqlalchemy.engines [None req-17550c03-96bf-4052-8607-e5d41daa41f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 20:36:05.056377 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_db.sqlalchemy.engines [None req-1f0f5b2e-97de-4b88-849d-46630d1dfcfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 20:36:05.057438 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_db.sqlalchemy.engines [None req-1f0f5b2e-97de-4b88-849d-46630d1dfcfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 20:36:05.213160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_db.sqlalchemy.engines [None req-17550c03-96bf-4052-8607-e5d41daa41f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 20:36:05.215696 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_db.sqlalchemy.engines [None req-1f0f5b2e-97de-4b88-849d-46630d1dfcfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 20:36:05.538935 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: WARNING keystonemiddleware.auth_token [None req-17550c03-96bf-4052-8607-e5d41daa41f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 20:36:05.539595 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: WARNING keystonemiddleware.auth_token [None req-1f0f5b2e-97de-4b88-849d-46630d1dfcfb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 20:36:05.546953 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: WARNING keystonemiddleware.auth_token [None req-17550c03-96bf-4052-8607-e5d41daa41f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 20:36:05.548016 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: WARNING keystonemiddleware.auth_token [None req-1f0f5b2e-97de-4b88-849d-46630d1dfcfb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 20:36:05.895569 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: WARNING keystonemiddleware.auth_token [None req-17550c03-96bf-4052-8607-e5d41daa41f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 20:36:05.899648 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: WARNING keystonemiddleware.auth_token [None req-1f0f5b2e-97de-4b88-849d-46630d1dfcfb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 20:36:05.901792 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: WARNING keystonemiddleware.auth_token [None req-17550c03-96bf-4052-8607-e5d41daa41f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 20:36:05.905906 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: WARNING keystonemiddleware.auth_token [None req-1f0f5b2e-97de-4b88-849d-46630d1dfcfb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 20:36:05.907130 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bc184d69c0 pid: 123563 (default app) May 16 20:36:05.911241 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bc184d69c0 pid: 123564 (default app) May 16 20:36:48.459595 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-41cf809d-b494-47aa-8ac1-1053a9a428e5 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Action: 'create', calling method: .version_select at 0x7f81b3192280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-496268580"}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:36:48.536577 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-edc7a6da-430f-4043-a197-4ac9dd7750c3 tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] Action: 'create', calling method: .version_select at 0x7f81b3193280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1454095350", "metadata": {"Type": "work"}}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:36:49.719394 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-41cf809d-b494-47aa-8ac1-1053a9a428e5 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.627254 May 16 20:36:49.720301 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1154 bytes} [Mon May 16 20:36:47 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2631 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 16 20:36:49.733049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-c4fdad44-99f2-46aa-8891-16d6a7083a77 tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] Calling method '.version_select at 0x7f81b2fe7280>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:50.203523 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-c4fdad44-99f2-46aa-8891-16d6a7083a77 tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/6d4329e5-2a4c-4651-912c-271742c245c3" status: 200 len: 351 microversion: 2.1 time: 0.479128 May 16 20:36:50.204172 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 2/2] 10.222.0.49 () {58 vars in 1244 bytes} [Mon May 16 20:36:49 2022] GET /compute/v2.1/os-volumes/6d4329e5-2a4c-4651-912c-271742c245c3 => generated 351 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:50.256011 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-edc7a6da-430f-4043-a197-4ac9dd7750c3 tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.004751 May 16 20:36:50.257131 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1155 bytes} [Mon May 16 20:36:47 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3008 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 16 20:36:50.267778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-2e37131e-c6b0-458b-930f-c2afbe9e1625 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Calling method '.version_select at 0x7f81b2fe9280>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:50.311900 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0118da35-4aef-4ceb-92e6-d794808c2a4d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1945271757", "imageRef": "f9826e12-1d0c-4a5a-9616-338520403016", "flavorRef": "452", "networks": [{"uuid": "cc3b1d5e-7bbe-4c49-a73e-f3a8cb5aac16"}]}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:36:50.474032 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-2e37131e-c6b0-458b-930f-c2afbe9e1625 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/e2139ee7-f61f-4371-ae4b-38604675081e" status: 200 len: 345 microversion: 2.1 time: 0.215461 May 16 20:36:50.475172 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1244 bytes} [Mon May 16 20:36:50 2022] GET /compute/v2.1/os-volumes/e2139ee7-f61f-4371-ae4b-38604675081e => generated 345 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:50.481292 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-fc1c7e69-e475-4046-9e0d-02cb2ba8d950 tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] Calling method '.version_select at 0x7f81b2fe9430>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:50.512733 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.network.neutron [None req-0118da35-4aef-4ceb-92e6-d794808c2a4d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] validate_networks() for [('cc3b1d5e-7bbe-4c49-a73e-f3a8cb5aac16', None, None, None, None, None)] {{(pid=123563) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:36:50.759229 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-fc1c7e69-e475-4046-9e0d-02cb2ba8d950 tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/83992a42-b356-4083-b729-13c343fb9c93" status: 200 len: 354 microversion: 2.1 time: 0.282321 May 16 20:36:50.759872 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 3/5] 10.222.0.49 () {58 vars in 1244 bytes} [Mon May 16 20:36:50 2022] GET /compute/v2.1/os-volumes/83992a42-b356-4083-b729-13c343fb9c93 => generated 354 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:50.779720 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-ccf06267-7fea-4298-9673-bb3fce2ac460 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Action: 'create', calling method: .version_select at 0x7f81b2fe99d0>, body: {"snapshot": {"volume_id": "e2139ee7-f61f-4371-ae4b-38604675081e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1872556503"}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:36:51.234503 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-ccf06267-7fea-4298-9673-bb3fce2ac460 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.463442 May 16 20:36:51.235134 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 4/6] 10.222.0.49 () {60 vars in 1161 bytes} [Mon May 16 20:36:50 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:51.241446 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-900afc74-cb8a-47bd-aa7d-e09ae0ddd35a tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] Calling method '.version_select at 0x7f81b2ff5670>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:51.314375 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-900afc74-cb8a-47bd-aa7d-e09ae0ddd35a tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/83992a42-b356-4083-b729-13c343fb9c93" status: 200 len: 354 microversion: 2.1 time: 0.078164 May 16 20:36:51.324157 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 5/7] 10.222.0.49 () {58 vars in 1244 bytes} [Mon May 16 20:36:51 2022] GET /compute/v2.1/os-volumes/83992a42-b356-4083-b729-13c343fb9c93 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:51.331843 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-64383131-55b2-46d5-8f6e-ad32d7f54afe tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Calling method '.version_select at 0x7f81b2fe9dc0>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:51.383227 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-64383131-55b2-46d5-8f6e-ad32d7f54afe tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/526beb0c-a84f-43ea-afb7-7ae8df40bb4d" status: 200 len: 287 microversion: 2.1 time: 0.057746 May 16 20:36:51.383973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 6/8] 10.222.0.49 () {58 vars in 1250 bytes} [Mon May 16 20:36:51 2022] GET /compute/v2.1/os-snapshots/526beb0c-a84f-43ea-afb7-7ae8df40bb4d => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:51.393183 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-886a2451-d7f4-4d2c-8b6d-7b1c882190a8 tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] Calling method '.version_select at 0x7f81b2fe9040>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:51.586622 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-886a2451-d7f4-4d2c-8b6d-7b1c882190a8 tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/83992a42-b356-4083-b729-13c343fb9c93" status: 202 len: 0 microversion: 2.1 time: 0.201660 May 16 20:36:51.587381 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 7/9] 10.222.0.49 () {58 vars in 1247 bytes} [Mon May 16 20:36:51 2022] DELETE /compute/v2.1/os-volumes/83992a42-b356-4083-b729-13c343fb9c93 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:36:51.595261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-93d061fa-0f69-4c90-8393-5c36340904fc tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Calling method '.version_select at 0x7f81b2ff5940>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:51.681094 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-93d061fa-0f69-4c90-8393-5c36340904fc tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.092253 May 16 20:36:51.681663 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 8/10] 10.222.0.49 () {58 vars in 1139 bytes} [Mon May 16 20:36:51 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:51.686402 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6bddaaa3-758d-46b0-9c92-32c301d20137 tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] Calling method '.version_select at 0x7f81b2fe94c0>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:51.817715 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-6bddaaa3-758d-46b0-9c92-32c301d20137 tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/83992a42-b356-4083-b729-13c343fb9c93" status: 200 len: 353 microversion: 2.1 time: 0.134962 May 16 20:36:51.818285 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 9/11] 10.222.0.49 () {58 vars in 1244 bytes} [Mon May 16 20:36:51 2022] GET /compute/v2.1/os-volumes/83992a42-b356-4083-b729-13c343fb9c93 => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:51.826400 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-3bbf5f99-df0c-4228-97af-ee2dda1e03b3 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Calling method '.version_select at 0x7f81b2fe9b80>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:51.895051 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-0118da35-4aef-4ceb-92e6-d794808c2a4d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Flavor limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:36:51.896371 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-0118da35-4aef-4ceb-92e6-d794808c2a4d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Image limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:36:51.897138 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-0118da35-4aef-4ceb-92e6-d794808c2a4d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Flavor pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:36:51.897962 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-0118da35-4aef-4ceb-92e6-d794808c2a4d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Image pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:36:51.898537 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-0118da35-4aef-4ceb-92e6-d794808c2a4d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:36:51.915695 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0118da35-4aef-4ceb-92e6-d794808c2a4d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:36:51.916409 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0118da35-4aef-4ceb-92e6-d794808c2a4d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:36:51.917463 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0118da35-4aef-4ceb-92e6-d794808c2a4d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:36:51.918106 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0118da35-4aef-4ceb-92e6-d794808c2a4d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:36:51.975870 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-3bbf5f99-df0c-4228-97af-ee2dda1e03b3 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/526beb0c-a84f-43ea-afb7-7ae8df40bb4d" status: 200 len: 287 microversion: 2.1 time: 0.156387 May 16 20:36:51.980419 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-0118da35-4aef-4ceb-92e6-d794808c2a4d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Getting quotas for project 17c116936d14470bb13850d6b8c83f8e. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:36:51.981475 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 10/12] 10.222.0.49 () {58 vars in 1250 bytes} [Mon May 16 20:36:51 2022] GET /compute/v2.1/os-snapshots/526beb0c-a84f-43ea-afb7-7ae8df40bb4d => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:51.986969 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-dc3ecdb8-975b-4c7d-81d8-04ee91c29847 tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] Calling method '.version_select at 0x7f81b2ff50d0>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:51.989719 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-0118da35-4aef-4ceb-92e6-d794808c2a4d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Getting quotas for user 0f2fd6d77aa949d5b5919432cb722b37 and project 17c116936d14470bb13850d6b8c83f8e. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:36:52.003720 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0118da35-4aef-4ceb-92e6-d794808c2a4d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Going to run 1 instances... {{(pid=123563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:36:52.007080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0118da35-4aef-4ceb-92e6-d794808c2a4d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9826e12-1d0c-4a5a-9616-338520403016',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:36:52.077203 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-dc3ecdb8-975b-4c7d-81d8-04ee91c29847 tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/e6a1af5e-12b4-49a1-a2d7-2af5adb2911f" status: 200 len: 351 microversion: 2.1 time: 0.094507 May 16 20:36:52.078246 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 11/13] 10.222.0.49 () {58 vars in 1244 bytes} [Mon May 16 20:36:51 2022] GET /compute/v2.1/os-volumes/e6a1af5e-12b4-49a1-a2d7-2af5adb2911f => generated 351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:52.143792 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0118da35-4aef-4ceb-92e6-d794808c2a4d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.938481 May 16 20:36:52.144951 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 3/14] 10.222.0.49 () {60 vars in 1146 bytes} [Mon May 16 20:36:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 20:36:52.155286 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-60ebcc2a-d1c9-45f8-9248-931189db00a1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:52.157203 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-60ebcc2a-d1c9-45f8-9248-931189db00a1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:36:52.446352 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-60ebcc2a-d1c9-45f8-9248-931189db00a1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:36:52.478457 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-60ebcc2a-d1c9-45f8-9248-931189db00a1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1215 microversion: 2.1 time: 0.322441 May 16 20:36:52.479538 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 12/15] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:36:52 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1215 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:36:52.831724 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-f140d9d6-97c1-4ba7-9cd2-1f7d079f23d6 tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] Calling method '.version_select at 0x7f81b26f5ee0>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:52.928246 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-f140d9d6-97c1-4ba7-9cd2-1f7d079f23d6 tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/83992a42-b356-4083-b729-13c343fb9c93" status: 200 len: 353 microversion: 2.1 time: 0.102099 May 16 20:36:52.930198 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 4/16] 10.222.0.49 () {58 vars in 1244 bytes} [Mon May 16 20:36:52 2022] GET /compute/v2.1/os-volumes/83992a42-b356-4083-b729-13c343fb9c93 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:52.987229 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-9f86b59e-639e-4eaa-9862-cbc34321dd11 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Calling method '.version_select at 0x7f81b2ff5d30>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:53.138752 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-9f86b59e-639e-4eaa-9862-cbc34321dd11 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/526beb0c-a84f-43ea-afb7-7ae8df40bb4d" status: 200 len: 287 microversion: 2.1 time: 0.154753 May 16 20:36:53.139408 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 13/17] 10.222.0.49 () {58 vars in 1250 bytes} [Mon May 16 20:36:52 2022] GET /compute/v2.1/os-snapshots/526beb0c-a84f-43ea-afb7-7ae8df40bb4d => generated 287 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:53.499372 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7244504b-0fd5-4b7f-8742-a334fc8df568 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:53.503746 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-7244504b-0fd5-4b7f-8742-a334fc8df568 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:36:53.830156 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-7244504b-0fd5-4b7f-8742-a334fc8df568 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:36:53.863180 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-7244504b-0fd5-4b7f-8742-a334fc8df568 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1215 microversion: 2.1 time: 0.370095 May 16 20:36:53.866874 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 5/18] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:36:53 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1215 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:36:53.945132 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-c43de9fb-3a1e-4d88-97d7-1288f591fe51 tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] Calling method '.version_select at 0x7f81b2fb4280>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:54.054631 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-c43de9fb-3a1e-4d88-97d7-1288f591fe51 tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/83992a42-b356-4083-b729-13c343fb9c93" status: 200 len: 353 microversion: 2.1 time: 0.116166 May 16 20:36:54.055700 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 14/19] 10.222.0.49 () {58 vars in 1244 bytes} [Mon May 16 20:36:53 2022] GET /compute/v2.1/os-volumes/83992a42-b356-4083-b729-13c343fb9c93 => generated 353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:54.152221 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7a6bc3ba-e3a5-4f9f-ae15-142ca51f7d34 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Calling method '.version_select at 0x7f81b26f5940>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:54.206837 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-7a6bc3ba-e3a5-4f9f-ae15-142ca51f7d34 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/526beb0c-a84f-43ea-afb7-7ae8df40bb4d" status: 200 len: 287 microversion: 2.1 time: 0.059264 May 16 20:36:54.207823 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 6/20] 10.222.0.49 () {58 vars in 1250 bytes} [Mon May 16 20:36:54 2022] GET /compute/v2.1/os-snapshots/526beb0c-a84f-43ea-afb7-7ae8df40bb4d => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:54.883507 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-b3e0457c-5e1b-4305-846b-2998ea2d5654 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:54.884593 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-b3e0457c-5e1b-4305-846b-2998ea2d5654 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:36:54.893467 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b3e0457c-5e1b-4305-846b-2998ea2d5654 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:36:54.897092 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b3e0457c-5e1b-4305-846b-2998ea2d5654 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:36:54.900344 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b3e0457c-5e1b-4305-846b-2998ea2d5654 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:36:54.901000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b3e0457c-5e1b-4305-846b-2998ea2d5654 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:36:55.067535 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-fb7b7e1f-fa99-4908-ace8-8760e09cae3b tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] Calling method '.version_select at 0x7f81b1ead8b0>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:55.192811 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-fb7b7e1f-fa99-4908-ace8-8760e09cae3b tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/83992a42-b356-4083-b729-13c343fb9c93" status: 200 len: 353 microversion: 2.1 time: 0.129200 May 16 20:36:55.198017 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 7/21] 10.222.0.49 () {58 vars in 1244 bytes} [Mon May 16 20:36:55 2022] GET /compute/v2.1/os-volumes/83992a42-b356-4083-b729-13c343fb9c93 => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:55.226761 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-c0316b6c-2f5e-45fa-9169-0348150000eb tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Calling method '.version_select at 0x7f81b1eadf70>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:55.271001 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-b3e0457c-5e1b-4305-846b-2998ea2d5654 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:36:55.318618 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-b3e0457c-5e1b-4305-846b-2998ea2d5654 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1211 microversion: 2.1 time: 0.440673 May 16 20:36:55.322221 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-c0316b6c-2f5e-45fa-9169-0348150000eb tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/526beb0c-a84f-43ea-afb7-7ae8df40bb4d" status: 200 len: 288 microversion: 2.1 time: 0.107266 May 16 20:36:55.323067 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 8/23] 10.222.0.49 () {58 vars in 1250 bytes} [Mon May 16 20:36:55 2022] GET /compute/v2.1/os-snapshots/526beb0c-a84f-43ea-afb7-7ae8df40bb4d => generated 288 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:55.323166 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 15/23] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:36:54 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1211 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:36:55.332695 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-218be096-55db-4292-a155-6b43e5d03b60 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Calling method '.version_select at 0x7f81b1eadb80>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:55.435258 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-218be096-55db-4292-a155-6b43e5d03b60 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/526beb0c-a84f-43ea-afb7-7ae8df40bb4d" status: 202 len: 0 microversion: 2.1 time: 0.106289 May 16 20:36:55.435830 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 9/24] 10.222.0.49 () {58 vars in 1253 bytes} [Mon May 16 20:36:55 2022] DELETE /compute/v2.1/os-snapshots/526beb0c-a84f-43ea-afb7-7ae8df40bb4d => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 20:36:55.449630 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-57baa541-f259-4489-acf8-dc3078804480 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Calling method '.version_select at 0x7f81b2f34af0>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:55.510201 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-57baa541-f259-4489-acf8-dc3078804480 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/526beb0c-a84f-43ea-afb7-7ae8df40bb4d" status: 200 len: 287 microversion: 2.1 time: 0.069720 May 16 20:36:55.510818 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 16/25] 10.222.0.49 () {58 vars in 1250 bytes} [Mon May 16 20:36:55 2022] GET /compute/v2.1/os-snapshots/526beb0c-a84f-43ea-afb7-7ae8df40bb4d => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:56.204979 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a63ebb7f-128b-4ed5-9232-7d9832920d24 tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] Calling method '.version_select at 0x7f81b2f451f0>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:56.211498 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-03c6d2c3-186a-4673-b150-78c57bc4ea80 tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] Calling method '.version_select at 0x7f81b1ead3a0>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:56.306153 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-a63ebb7f-128b-4ed5-9232-7d9832920d24 tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/83992a42-b356-4083-b729-13c343fb9c93" status: 200 len: 353 microversion: 2.1 time: 0.105056 May 16 20:36:56.311135 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 17/26] 10.222.0.49 () {58 vars in 1244 bytes} [Mon May 16 20:36:56 2022] GET /compute/v2.1/os-volumes/83992a42-b356-4083-b729-13c343fb9c93 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:56.342694 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-df244974-4550-4592-a9e8-2669978f2b04 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:56.342839 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-df244974-4550-4592-a9e8-2669978f2b04 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:36:56.357282 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-df244974-4550-4592-a9e8-2669978f2b04 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:36:56.357740 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-df244974-4550-4592-a9e8-2669978f2b04 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:36:56.358526 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-df244974-4550-4592-a9e8-2669978f2b04 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:36:56.359104 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-df244974-4550-4592-a9e8-2669978f2b04 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:36:56.394465 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-03c6d2c3-186a-4673-b150-78c57bc4ea80 tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/e4e7c71e-3fd9-46c5-b49c-991cef22f8a4" status: 200 len: 350 microversion: 2.1 time: 0.197384 May 16 20:36:56.395824 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 10/27] 10.222.0.49 () {58 vars in 1244 bytes} [Mon May 16 20:36:56 2022] GET /compute/v2.1/os-volumes/e4e7c71e-3fd9-46c5-b49c-991cef22f8a4 => generated 350 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:56.485305 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-df244974-4550-4592-a9e8-2669978f2b04 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:36:56.494807 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-75b3dded-d3cf-4513-a1bd-65b6927c2b9c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Action: 'create', calling method: .version_select at 0x7f81b271d430>, body: {"keypair": {"name": "tempest-keypair-326918533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6yQsXxDXtKn0pNmrVoTzxg5lHv0st40tqv6+s1TtiCns7L0UW6K3qEbZXLqAC2foKxiCGf8Bq4FdmzC1iwTvkA2ZiM5otviyb6OBGMdCzsyGK3gtyyE87iya+YITrypA=="}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:36:56.496562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-df244974-4550-4592-a9e8-2669978f2b04 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1211 microversion: 2.1 time: 0.158365 May 16 20:36:56.497731 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 18/28] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:36:56 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1211 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:36:56.503206 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-63b1e8d8-2248-418f-923e-2a1591a357a4 tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] Calling method '.version_select at 0x7f81b2f45790>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:56.524940 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-75b3dded-d3cf-4513-a1bd-65b6927c2b9c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Getting quotas for project 970ed3a09b3e490399fa39d38e97f9cb. Resources: {'key_pairs'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:36:56.529500 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-75b3dded-d3cf-4513-a1bd-65b6927c2b9c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Getting quotas for user de3dd9262fba4830be6c4477628f2061 and project 970ed3a09b3e490399fa39d38e97f9cb. Resources: {'key_pairs'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:36:56.590524 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-75b3dded-d3cf-4513-a1bd-65b6927c2b9c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.193150 May 16 20:36:56.595381 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 11/29] 10.222.0.49 () {62 vars in 1199 bytes} [Mon May 16 20:36:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 199 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 16 20:36:56.611584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-63b1e8d8-2248-418f-923e-2a1591a357a4 tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.112595 May 16 20:36:56.612226 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 19/30] 10.222.0.49 () {58 vars in 1133 bytes} [Mon May 16 20:36:56 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:36:56.614403 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-60c86dfb-a54a-4088-8dac-70b66a930179 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Calling method '.version_select at 0x7f81b1eb7040>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:56.626811 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e51d853d-4f5d-40c7-8c88-df305bf25beb tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] Calling method '.version_select at 0x7f81b2ee79d0>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:56.658007 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-60c86dfb-a54a-4088-8dac-70b66a930179 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/526beb0c-a84f-43ea-afb7-7ae8df40bb4d" status: 200 len: 287 microversion: 2.1 time: 0.061403 May 16 20:36:56.662945 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 12/31] 10.222.0.49 () {58 vars in 1250 bytes} [Mon May 16 20:36:56 2022] GET /compute/v2.1/os-snapshots/526beb0c-a84f-43ea-afb7-7ae8df40bb4d => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:56.749679 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-e51d853d-4f5d-40c7-8c88-df305bf25beb tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.126628 May 16 20:36:56.750336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 20/32] 10.222.0.49 () {58 vars in 1148 bytes} [Mon May 16 20:36:56 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:36:56.767493 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-fa685c49-5cd6-4405-8a77-7bd0938ce63a tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] Calling method '.version_select at 0x7f81b2f4e0d0>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:56.773577 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-9804b033-8808-4a02-a789-8833f7608910 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Action: 'create', calling method: .version_select at 0x7f81b1ede1f0>, body: {"keypair": {"name": "tempest-keypair-210253230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUKbgtOcFgIg3vyPzDOBE2zKpHpJnKpHOP0DcgCoTq4jaZ+XKBWe4AM5xkIWGk3q1cch58AbUw8DTywzQ1nf26t1OF8SNBPEXE40L/vlABj6R000+5hQ/rsIExCxvXq1A=="}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:36:56.796785 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-9804b033-8808-4a02-a789-8833f7608910 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Getting quotas for project 2beaab3a72a345d98a9ec4e0ae4686b6. Resources: {'key_pairs'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:36:56.805928 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-9804b033-8808-4a02-a789-8833f7608910 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Getting quotas for user b578680e88c741bda2c8e56b2dc9d335 and project 2beaab3a72a345d98a9ec4e0ae4686b6. Resources: {'key_pairs'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:36:56.841880 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-9804b033-8808-4a02-a789-8833f7608910 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.177500 May 16 20:36:56.842908 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 13/33] 10.222.0.49 () {60 vars in 1158 bytes} [Mon May 16 20:36:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:56.897281 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-fa685c49-5cd6-4405-8a77-7bd0938ce63a tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.136600 May 16 20:36:56.897973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 21/34] 10.222.0.49 () {58 vars in 1133 bytes} [Mon May 16 20:36:56 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:36:56.909554 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-6d8fa72e-50fa-4103-b98a-c5b82849eeda tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] Calling method '.version_select at 0x7f81b1edeb80>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:57.005673 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-6d8fa72e-50fa-4103-b98a-c5b82849eeda tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.100273 May 16 20:36:57.015674 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 14/35] 10.222.0.49 () {58 vars in 1166 bytes} [Mon May 16 20:36:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:57.019758 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-b0b5970c-c7c5-41ea-b075-299855a5b941 tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] Calling method '.version_select at 0x7f81b2ef69d0>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:57.130281 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-b0b5970c-c7c5-41ea-b075-299855a5b941 tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.114775 May 16 20:36:57.131181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 22/36] 10.222.0.49 () {58 vars in 1169 bytes} [Mon May 16 20:36:57 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:57.145057 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-ffc13034-04a6-40a9-a01b-5ce247f85a8e tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] Calling method '.version_select at 0x7f81b1eb70d0>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:57.289133 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-ffc13034-04a6-40a9-a01b-5ce247f85a8e tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.147929 May 16 20:36:57.299072 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 15/37] 10.222.0.49 () {58 vars in 1154 bytes} [Mon May 16 20:36:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:36:57.302447 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-19e48a0a-7a4f-44ca-90fd-9da18c4f37dc tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] Calling method '.version_select at 0x7f81b2fb4550>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:57.320999 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-6b0168f4-aa3d-4059-a231-e8a540b48773 tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] Calling method '.version_select at 0x7f81b1661700>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:57.403072 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-6b0168f4-aa3d-4059-a231-e8a540b48773 tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/83992a42-b356-4083-b729-13c343fb9c93" status: 200 len: 353 microversion: 2.1 time: 0.085740 May 16 20:36:57.404463 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 16/38] 10.222.0.49 () {58 vars in 1244 bytes} [Mon May 16 20:36:57 2022] GET /compute/v2.1/os-volumes/83992a42-b356-4083-b729-13c343fb9c93 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:57.461564 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-19e48a0a-7a4f-44ca-90fd-9da18c4f37dc tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.164296 May 16 20:36:57.468974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 23/39] 10.222.0.49 () {58 vars in 1187 bytes} [Mon May 16 20:36:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:36:57.474289 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-bdeed181-10f2-4bd3-9ad1-f816ef70b521 tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] Calling method '.version_select at 0x7f81b1eb7160>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:57.513240 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-998948c7-ee76-42bf-bbbc-ec734bee66d2 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:57.513963 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-998948c7-ee76-42bf-bbbc-ec734bee66d2 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:36:57.526636 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-998948c7-ee76-42bf-bbbc-ec734bee66d2 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:36:57.527876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-998948c7-ee76-42bf-bbbc-ec734bee66d2 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:36:57.530705 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-998948c7-ee76-42bf-bbbc-ec734bee66d2 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:36:57.532602 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-998948c7-ee76-42bf-bbbc-ec734bee66d2 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:36:57.578796 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-bdeed181-10f2-4bd3-9ad1-f816ef70b521 tempest-VolumesTestJSON-1865743194 tempest-VolumesTestJSON-1865743194-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.108299 May 16 20:36:57.587362 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 17/40] 10.222.0.49 () {58 vars in 1154 bytes} [Mon May 16 20:36:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:36:57.672050 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-68a1ddf8-efff-45f7-a0ca-13c34dd04eff tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Calling method '.version_select at 0x7f81b1ede700>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:57.709540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-998948c7-ee76-42bf-bbbc-ec734bee66d2 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:36:57.726643 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-998948c7-ee76-42bf-bbbc-ec734bee66d2 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1211 microversion: 2.1 time: 0.217155 May 16 20:36:57.746424 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 24/41] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:36:57 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1211 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:36:57.774172 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-68a1ddf8-efff-45f7-a0ca-13c34dd04eff tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/526beb0c-a84f-43ea-afb7-7ae8df40bb4d" status: 200 len: 287 microversion: 2.1 time: 0.107322 May 16 20:36:57.774745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 18/42] 10.222.0.49 () {58 vars in 1250 bytes} [Mon May 16 20:36:57 2022] GET /compute/v2.1/os-snapshots/526beb0c-a84f-43ea-afb7-7ae8df40bb4d => generated 287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:36:58.416960 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a2f6fdd6-2ae4-410e-8ca7-19c4d0f39692 tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] Calling method '.version_select at 0x7f81b2f458b0>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:58.450723 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-a2f6fdd6-2ae4-410e-8ca7-19c4d0f39692 tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] HTTP exception thrown: Volume 83992a42-b356-4083-b729-13c343fb9c93 could not be found. May 16 20:36:58.464465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a2f6fdd6-2ae4-410e-8ca7-19c4d0f39692 tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] Request method failure captured: May 16 20:36:58.464465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: GET /compute/v2.1/os-volumes/83992a42-b356-4083-b729-13c343fb9c93 HTTP/1.1 May 16 20:36:58.464465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:36:58.464465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:36:58.464465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:36:58.464465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:36:58.464465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:36:58.464465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:36:58.464465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:36:58.464465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:36:58.464465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrXf0yzIIeS8WDANITXbK48G7Lxp0fVtuluSCrZrvXYgfnaJkzlm0lK8j7SeiKsQ0nhjWsf9k1Z9a1Tzp0vpu1YIG8kWhTT095v7g7_fhpcHrf9QNMLlhebuR1y1xHs5BB0VAD4r3YcKdAiCEjNm3xgnnXqqfIUKmXiR0EwFzix6fI8 May 16 20:36:58.464465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:36:58.464465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:36:58.464465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:36:58.464465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:36:58.464465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:36:58.464465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:36:58.464465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 3c936d9f5e7445a9829155fc6703a0f0 May 16 20:36:58.464465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-VolumesGetTestJSON-397517982 May 16 20:36:58.464465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:36:58.464465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:36:58.466236 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c936d9f5e7445a9829155fc6703a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c936d9f5e7445a9829155fc6703a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c936d9f5e7445a9829155fc6703a0f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c936d9f5e7445a9829155fc6703a0f0"}]}] May 16 20:36:58.466236 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-VolumesGetTestJSON-397517982 May 16 20:36:58.466236 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 3c936d9f5e7445a9829155fc6703a0f0 May 16 20:36:58.466236 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-VolumesGetTestJSON-397517982 May 16 20:36:58.466236 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-VolumesGetTestJSON-397517982-project May 16 20:36:58.466236 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:36:58.466236 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:36:58.466236 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: 9429845a17224ee7930c907177886aad May 16 20:36:58.466236 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-VolumesGetTestJSON-397517982-project May 16 20:36:58.466236 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: May 16 20:36:58.466236 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Volume 83992a42-b356-4083-b729-13c343fb9c93 could not be found. May 16 20:36:58.466236 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': '83992a42-b356-4083-b729-13c343fb9c93'} May 16 20:36:58.466236 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:36:58.467039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:36:58.467039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 20:36:58.467039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 20:36:58.467039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 20:36:58.467039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 20:36:58.467039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 20:36:58.467039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 20:36:58.467039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 20:36:58.467039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 20:36:58.467039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 20:36:58.467039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 20:36:58.467039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 20:36:58.467039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 20:36:58.467039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 20:36:58.467039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 20:36:58.467039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 83992a42-b356-4083-b729-13c343fb9c93 could not be found. (HTTP 404) (Request-ID: req-4e7e815a-0b5d-4e11-a64c-c45a711b41db) May 16 20:36:58.467039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:36:58.467039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:36:58.467039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:36:58.469116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:36:58.469116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 20:36:58.469116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 20:36:58.469116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 20:36:58.469116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 20:36:58.469116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 20:36:58.469116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 20:36:58.469116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 20:36:58.469116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 20:36:58.469116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 20:36:58.469116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 20:36:58.469116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 20:36:58.469116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 20:36:58.469116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 20:36:58.469116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 20:36:58.469116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 20:36:58.469116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 20:36:58.469116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 20:36:58.469116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 20:36:58.471107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 20:36:58.471107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 20:36:58.471107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 20:36:58.471107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 20:36:58.471107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 83992a42-b356-4083-b729-13c343fb9c93 could not be found. May 16 20:36:58.471107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:36:58.471107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:36:58.471107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:36:58.471107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:36:58.471107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:36:58.471107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:36:58.471107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:36:58.471107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:36:58.471107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 20:36:58.471107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 20:36:58.471107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:36:58.471107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:36:58.471107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 20:36:58.471107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:36:58.473050 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 83992a42-b356-4083-b729-13c343fb9c93 could not be found. May 16 20:36:58.473050 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:36:58.473050 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:36:58.473050 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:36:58.473050 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:36:58.473050 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:36:58.473050 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:36:58.473050 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:36:58.473050 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:36:58.473050 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 83992a42-b356-4083-b729-13c343fb9c93 could not be found. May 16 20:36:58.473050 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:36:58.473050 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a2f6fdd6-2ae4-410e-8ca7-19c4d0f39692 tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] Returning 404 to user: Volume 83992a42-b356-4083-b729-13c343fb9c93 could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:36:58.473050 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-a2f6fdd6-2ae4-410e-8ca7-19c4d0f39692 tempest-VolumesGetTestJSON-397517982 tempest-VolumesGetTestJSON-397517982-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/83992a42-b356-4083-b729-13c343fb9c93" status: 404 len: 109 microversion: 2.1 time: 0.053498 May 16 20:36:58.473050 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 25/43] 10.222.0.49 () {58 vars in 1244 bytes} [Mon May 16 20:36:58 2022] GET /compute/v2.1/os-volumes/83992a42-b356-4083-b729-13c343fb9c93 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:36:58.745474 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-ce7bfa3b-8281-442f-9527-29216d0c61aa tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:58.746727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-ce7bfa3b-8281-442f-9527-29216d0c61aa tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:36:58.765304 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ce7bfa3b-8281-442f-9527-29216d0c61aa tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:36:58.766022 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ce7bfa3b-8281-442f-9527-29216d0c61aa tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:36:58.767073 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ce7bfa3b-8281-442f-9527-29216d0c61aa tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:36:58.770231 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ce7bfa3b-8281-442f-9527-29216d0c61aa tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:36:58.792337 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-91926d62-bdbc-4e4f-a96b-70fbb73c516c tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Calling method '.version_select at 0x7f81b354df70>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:58.872008 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-91926d62-bdbc-4e4f-a96b-70fbb73c516c tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] HTTP exception thrown: Snapshot 526beb0c-a84f-43ea-afb7-7ae8df40bb4d could not be found. May 16 20:36:58.874551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-91926d62-bdbc-4e4f-a96b-70fbb73c516c tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Request method failure captured: May 16 20:36:58.874551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: GET /compute/v2.1/os-snapshots/526beb0c-a84f-43ea-afb7-7ae8df40bb4d HTTP/1.1 May 16 20:36:58.874551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:36:58.874551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:36:58.874551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:36:58.874551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:36:58.874551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:36:58.874551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:36:58.874551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:36:58.874551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:36:58.874551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrXf7cT-614ZSX2gHW_e_Lp0LDmQ2Ptn5RfvavpvUMQrvpWTq9O7FmC4b5A32uWTudt0EGwIjmGslsocDxgLZG6aUwAs9WuVCqR9rUzW_NhgnJ0xVYnuCkEMf9yc_W3mIeAjOsPTydiNoubgkb34GjYZmv9ITjURTEB_obq9SDED9S0 May 16 20:36:58.874551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:36:58.874551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:36:58.874551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:36:58.874551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:36:58.874551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:36:58.874551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:36:58.874551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: ff2f097602f64521be30fcac0c86ca14 May 16 20:36:58.874551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-907751259 May 16 20:36:58.874551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:36:58.874551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:36:58.875613 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ff2f097602f64521be30fcac0c86ca14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ff2f097602f64521be30fcac0c86ca14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ff2f097602f64521be30fcac0c86ca14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ff2f097602f64521be30fcac0c86ca14"}]}] May 16 20:36:58.875613 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-VolumesSnapshotsTestJSON-907751259 May 16 20:36:58.875613 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: ff2f097602f64521be30fcac0c86ca14 May 16 20:36:58.875613 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-907751259 May 16 20:36:58.875613 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-VolumesSnapshotsTestJSON-907751259-project May 16 20:36:58.875613 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:36:58.875613 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:36:58.875613 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: bd26cc840b9e480b890ca2c1f662ed4c May 16 20:36:58.875613 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-VolumesSnapshotsTestJSON-907751259-project May 16 20:36:58.875613 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: May 16 20:36:58.875613 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Snapshot 526beb0c-a84f-43ea-afb7-7ae8df40bb4d could not be found. May 16 20:36:58.875613 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': '526beb0c-a84f-43ea-afb7-7ae8df40bb4d'} May 16 20:36:58.875613 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:36:58.876354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:36:58.876354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 16 20:36:58.876354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 16 20:36:58.876354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 16 20:36:58.876354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 16 20:36:58.876354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 16 20:36:58.876354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 16 20:36:58.876354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 20:36:58.876354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 20:36:58.876354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 20:36:58.876354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 20:36:58.876354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 20:36:58.876354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 20:36:58.876354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 20:36:58.876354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 20:36:58.876354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 526beb0c-a84f-43ea-afb7-7ae8df40bb4d could not be found. (HTTP 404) (Request-ID: req-e947749f-8663-457d-86c8-8308880e6af6) May 16 20:36:58.876354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:36:58.876354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:36:58.877257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:36:58.877257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:36:58.877257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 16 20:36:58.877257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 16 20:36:58.877257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 20:36:58.877257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 20:36:58.877257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 16 20:36:58.877257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 16 20:36:58.877257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 20:36:58.877257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 20:36:58.877257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 16 20:36:58.877257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 16 20:36:58.877257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 16 20:36:58.877257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 16 20:36:58.877257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 16 20:36:58.877257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 16 20:36:58.877257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 20:36:58.877257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 20:36:58.877257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 20:36:58.878179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 20:36:58.878179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 20:36:58.878179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 20:36:58.878179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 20:36:58.878179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 20:36:58.878179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 526beb0c-a84f-43ea-afb7-7ae8df40bb4d could not be found. May 16 20:36:58.878179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:36:58.878179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:36:58.878179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:36:58.878179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:36:58.878179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:36:58.878179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:36:58.878179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:36:58.878179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:36:58.878179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 20:36:58.878179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 20:36:58.878179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:36:58.878179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:36:58.878179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 16 20:36:58.878179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:36:58.879119 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 526beb0c-a84f-43ea-afb7-7ae8df40bb4d could not be found. May 16 20:36:58.879119 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:36:58.879119 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:36:58.879119 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:36:58.879119 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:36:58.879119 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:36:58.879119 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:36:58.879119 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:36:58.879119 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:36:58.879119 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 526beb0c-a84f-43ea-afb7-7ae8df40bb4d could not be found. May 16 20:36:58.879119 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:36:58.881660 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-91926d62-bdbc-4e4f-a96b-70fbb73c516c tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Returning 404 to user: Snapshot 526beb0c-a84f-43ea-afb7-7ae8df40bb4d could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:36:58.883092 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-91926d62-bdbc-4e4f-a96b-70fbb73c516c tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/526beb0c-a84f-43ea-afb7-7ae8df40bb4d" status: 404 len: 111 microversion: 2.1 time: 0.098956 May 16 20:36:58.883867 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 26/44] 10.222.0.49 () {58 vars in 1250 bytes} [Mon May 16 20:36:58 2022] GET /compute/v2.1/os-snapshots/526beb0c-a84f-43ea-afb7-7ae8df40bb4d => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 20:36:58.892151 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-22fe6ca2-ca41-495e-9b36-bc9bcb8a7aac tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Calling method '.version_select at 0x7f81b2f45700>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:59.058829 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-22fe6ca2-ca41-495e-9b36-bc9bcb8a7aac tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/e2139ee7-f61f-4371-ae4b-38604675081e" status: 202 len: 0 microversion: 2.1 time: 0.169782 May 16 20:36:59.060265 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 27/45] 10.222.0.49 () {58 vars in 1247 bytes} [Mon May 16 20:36:58 2022] DELETE /compute/v2.1/os-volumes/e2139ee7-f61f-4371-ae4b-38604675081e => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:36:59.070146 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-407ca7e8-435b-4709-a0d0-6aaa533882e3 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Calling method '.version_select at 0x7f81b2f45550>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:36:59.197240 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-407ca7e8-435b-4709-a0d0-6aaa533882e3 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/e2139ee7-f61f-4371-ae4b-38604675081e" status: 200 len: 344 microversion: 2.1 time: 0.132303 May 16 20:36:59.198540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 28/46] 10.222.0.49 () {58 vars in 1244 bytes} [Mon May 16 20:36:59 2022] GET /compute/v2.1/os-volumes/e2139ee7-f61f-4371-ae4b-38604675081e => generated 344 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:36:59.394895 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ce7bfa3b-8281-442f-9527-29216d0c61aa tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:36:59.419805 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-ce7bfa3b-8281-442f-9527-29216d0c61aa tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1267 microversion: 2.1 time: 0.678648 May 16 20:36:59.430894 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 19/47] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:36:58 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1267 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:36:59.584339 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-03b32a26-75e2-4c9b-8b73-6e005d454b06 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-134082112", "imageRef": "f9826e12-1d0c-4a5a-9616-338520403016", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51755a9b-e432-418d-95c4-023d6854f406"}], "security_groups": [{"name": "tempest-securitygroup--1727690576"}], "key_name": "tempest-keypair-210253230", "user_data": "}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:36:59.861337 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-dc68a354-59e5-4ebb-bcfb-5fb9af57281f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1624211040", "imageRef": "f9826e12-1d0c-4a5a-9616-338520403016", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ecfbded1-d8d9-4f26-a9bd-62198a15a84a"}], "security_groups": [{"name": "tempest-securitygroup--544719050"}], "key_name": "tempest-keypair-326918533", "user_data": "}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:36:59.956320 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.network.neutron [None req-03b32a26-75e2-4c9b-8b73-6e005d454b06 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] validate_networks() for [('51755a9b-e432-418d-95c4-023d6854f406', None, None, None, None, None)] {{(pid=123564) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:37:00.157572 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.network.neutron [None req-dc68a354-59e5-4ebb-bcfb-5fb9af57281f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] validate_networks() for [('ecfbded1-d8d9-4f26-a9bd-62198a15a84a', None, None, None, None, None)] {{(pid=123563) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:37:00.741027 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-dc68a354-59e5-4ebb-bcfb-5fb9af57281f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Flavor limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:37:00.741460 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-dc68a354-59e5-4ebb-bcfb-5fb9af57281f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Image limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:37:00.742025 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-dc68a354-59e5-4ebb-bcfb-5fb9af57281f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Flavor pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:37:00.742331 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-dc68a354-59e5-4ebb-bcfb-5fb9af57281f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Image pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:37:00.742747 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-dc68a354-59e5-4ebb-bcfb-5fb9af57281f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:37:00.754238 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dc68a354-59e5-4ebb-bcfb-5fb9af57281f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:00.754969 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dc68a354-59e5-4ebb-bcfb-5fb9af57281f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:00.756103 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dc68a354-59e5-4ebb-bcfb-5fb9af57281f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:00.756981 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dc68a354-59e5-4ebb-bcfb-5fb9af57281f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:00.784456 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-dc68a354-59e5-4ebb-bcfb-5fb9af57281f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Getting quotas for project 970ed3a09b3e490399fa39d38e97f9cb. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:37:00.789394 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-dc68a354-59e5-4ebb-bcfb-5fb9af57281f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Getting quotas for user de3dd9262fba4830be6c4477628f2061 and project 970ed3a09b3e490399fa39d38e97f9cb. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:37:00.805292 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-dc68a354-59e5-4ebb-bcfb-5fb9af57281f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Going to run 1 instances... {{(pid=123563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:37:00.808335 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-dc68a354-59e5-4ebb-bcfb-5fb9af57281f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9826e12-1d0c-4a5a-9616-338520403016',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:37:00.899480 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-dc68a354-59e5-4ebb-bcfb-5fb9af57281f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.047431 May 16 20:37:00.901884 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 20/48] 10.222.0.49 () {62 vars in 1187 bytes} [Mon May 16 20:36:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 16 20:37:00.914053 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0fc23c29-26c3-4b2c-8e02-44e9b376aabf tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Calling method '.version_select at 0x7f81b1658820>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:00.989644 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0fc23c29-26c3-4b2c-8e02-44e9b376aabf tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/e2139ee7-f61f-4371-ae4b-38604675081e" status: 200 len: 344 microversion: 2.1 time: 0.085326 May 16 20:37:00.990960 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 21/49] 10.222.0.49 () {58 vars in 1244 bytes} [Mon May 16 20:37:00 2022] GET /compute/v2.1/os-volumes/e2139ee7-f61f-4371-ae4b-38604675081e => generated 344 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:37:01.006979 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-809474bf-b83b-4c71-b743-4143862151d8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:01.008072 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-809474bf-b83b-4c71-b743-4143862151d8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:01.038477 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-809474bf-b83b-4c71-b743-4143862151d8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:01.044965 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-809474bf-b83b-4c71-b743-4143862151d8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:01.048004 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-809474bf-b83b-4c71-b743-4143862151d8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:01.048675 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-809474bf-b83b-4c71-b743-4143862151d8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:01.268187 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-809474bf-b83b-4c71-b743-4143862151d8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:01.287405 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-809474bf-b83b-4c71-b743-4143862151d8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1275 microversion: 2.1 time: 0.293721 May 16 20:37:01.290789 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 22/50] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:00 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1275 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:01.311754 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-f8fe374a-b114-466d-b8d3-c56fd1876e76 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:01.313447 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-f8fe374a-b114-466d-b8d3-c56fd1876e76 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:01.500477 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f8fe374a-b114-466d-b8d3-c56fd1876e76 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:01.505196 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-03b32a26-75e2-4c9b-8b73-6e005d454b06 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Flavor limits 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:37:01.506323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-03b32a26-75e2-4c9b-8b73-6e005d454b06 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Image limits 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:37:01.506938 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-03b32a26-75e2-4c9b-8b73-6e005d454b06 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Flavor pref 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:37:01.507526 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-03b32a26-75e2-4c9b-8b73-6e005d454b06 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Image pref 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:37:01.508095 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-03b32a26-75e2-4c9b-8b73-6e005d454b06 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:37:01.515218 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f8fe374a-b114-466d-b8d3-c56fd1876e76 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:01.517772 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f8fe374a-b114-466d-b8d3-c56fd1876e76 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:01.521339 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-f8fe374a-b114-466d-b8d3-c56fd1876e76 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1281 microversion: 2.20 time: 0.229250 May 16 20:37:01.524798 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 23/51] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:01 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1281 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:37:01.543776 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-03b32a26-75e2-4c9b-8b73-6e005d454b06 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:01.544219 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-03b32a26-75e2-4c9b-8b73-6e005d454b06 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:01.558866 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-03b32a26-75e2-4c9b-8b73-6e005d454b06 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:01.559274 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-03b32a26-75e2-4c9b-8b73-6e005d454b06 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:01.676690 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-03b32a26-75e2-4c9b-8b73-6e005d454b06 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Getting quotas for project 2beaab3a72a345d98a9ec4e0ae4686b6. Resources: {'cores', 'ram', 'instances'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:37:01.687457 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-03b32a26-75e2-4c9b-8b73-6e005d454b06 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Getting quotas for user b578680e88c741bda2c8e56b2dc9d335 and project 2beaab3a72a345d98a9ec4e0ae4686b6. Resources: {'cores', 'ram', 'instances'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:37:01.714217 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-03b32a26-75e2-4c9b-8b73-6e005d454b06 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Going to run 1 instances... {{(pid=123564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:37:01.722713 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-03b32a26-75e2-4c9b-8b73-6e005d454b06 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9826e12-1d0c-4a5a-9616-338520403016',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:37:01.975845 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-03b32a26-75e2-4c9b-8b73-6e005d454b06 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.413164 May 16 20:37:01.984904 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 29/52] 10.222.0.49 () {60 vars in 1146 bytes} [Mon May 16 20:36:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 2423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 20:37:01.990004 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-73bd5c12-0019-44e3-82fc-98ffe3b567e6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:01.991320 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-73bd5c12-0019-44e3-82fc-98ffe3b567e6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:02.006841 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-c816ac9d-b9bc-428c-85b9-22d05b99ef46 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Calling method '.version_select at 0x7f81b25be310>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:02.137993 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-73bd5c12-0019-44e3-82fc-98ffe3b567e6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:02.150527 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-73bd5c12-0019-44e3-82fc-98ffe3b567e6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1240 microversion: 2.1 time: 0.164288 May 16 20:37:02.152562 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 24/53] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:01 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1240 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:02.309850 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2d4c5e67-d2e2-4d2b-97fc-528788092691 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:02.310632 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-2d4c5e67-d2e2-4d2b-97fc-528788092691 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:02.325665 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2d4c5e67-d2e2-4d2b-97fc-528788092691 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:02.333945 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2d4c5e67-d2e2-4d2b-97fc-528788092691 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:02.340898 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2d4c5e67-d2e2-4d2b-97fc-528788092691 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:02.345247 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2d4c5e67-d2e2-4d2b-97fc-528788092691 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:02.435513 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-c816ac9d-b9bc-428c-85b9-22d05b99ef46 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] HTTP exception thrown: Volume e2139ee7-f61f-4371-ae4b-38604675081e could not be found. May 16 20:37:02.438245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-c816ac9d-b9bc-428c-85b9-22d05b99ef46 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Request method failure captured: May 16 20:37:02.438245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: GET /compute/v2.1/os-volumes/e2139ee7-f61f-4371-ae4b-38604675081e HTTP/1.1 May 16 20:37:02.438245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:37:02.438245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:37:02.438245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:37:02.438245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:37:02.438245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:37:02.438245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:37:02.438245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:37:02.438245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:37:02.438245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrXf7cT-614ZSX2gHW_e_Lp0LDmQ2Ptn5RfvavpvUMQrvpWTq9O7FmC4b5A32uWTudt0EGwIjmGslsocDxgLZG6aUwAs9WuVCqR9rUzW_NhgnJ0xVYnuCkEMf9yc_W3mIeAjOsPTydiNoubgkb34GjYZmv9ITjURTEB_obq9SDED9S0 May 16 20:37:02.438245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:37:02.438245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:37:02.438245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:37:02.438245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:37:02.438245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:37:02.438245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:37:02.438245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: ff2f097602f64521be30fcac0c86ca14 May 16 20:37:02.438245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-907751259 May 16 20:37:02.438245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:37:02.438245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:37:02.439365 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ff2f097602f64521be30fcac0c86ca14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ff2f097602f64521be30fcac0c86ca14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ff2f097602f64521be30fcac0c86ca14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ff2f097602f64521be30fcac0c86ca14"}]}] May 16 20:37:02.439365 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-VolumesSnapshotsTestJSON-907751259 May 16 20:37:02.439365 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: ff2f097602f64521be30fcac0c86ca14 May 16 20:37:02.439365 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-907751259 May 16 20:37:02.439365 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-VolumesSnapshotsTestJSON-907751259-project May 16 20:37:02.439365 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:37:02.439365 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:37:02.439365 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: bd26cc840b9e480b890ca2c1f662ed4c May 16 20:37:02.439365 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-VolumesSnapshotsTestJSON-907751259-project May 16 20:37:02.439365 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: May 16 20:37:02.439365 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Volume e2139ee7-f61f-4371-ae4b-38604675081e could not be found. May 16 20:37:02.439365 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': 'e2139ee7-f61f-4371-ae4b-38604675081e'} May 16 20:37:02.439365 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:37:02.440012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:02.440012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 20:37:02.440012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 20:37:02.440012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 20:37:02.440012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 20:37:02.440012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 20:37:02.440012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 20:37:02.440012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 20:37:02.440012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 20:37:02.440012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 20:37:02.440012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 20:37:02.440012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 20:37:02.440012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 20:37:02.440012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 20:37:02.440012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 20:37:02.440012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e2139ee7-f61f-4371-ae4b-38604675081e could not be found. (HTTP 404) (Request-ID: req-d2bb207f-2d32-4eed-8921-4e5ad15d5a88) May 16 20:37:02.440012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:37:02.440012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:02.440012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:37:02.441545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:02.441545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 20:37:02.441545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 20:37:02.441545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 20:37:02.441545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 20:37:02.441545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 20:37:02.441545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 20:37:02.441545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 20:37:02.441545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 20:37:02.441545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 20:37:02.441545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 20:37:02.441545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 20:37:02.441545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 20:37:02.441545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 20:37:02.441545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 20:37:02.441545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 20:37:02.441545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 20:37:02.441545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 20:37:02.441545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 20:37:02.442455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 20:37:02.442455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 20:37:02.442455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 20:37:02.442455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 20:37:02.442455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e2139ee7-f61f-4371-ae4b-38604675081e could not be found. May 16 20:37:02.442455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:37:02.442455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:02.442455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:37:02.442455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:02.442455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:37:02.442455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:37:02.442455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:37:02.442455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:37:02.442455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 20:37:02.442455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 20:37:02.442455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:37:02.442455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:37:02.442455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 20:37:02.442455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:37:02.443347 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e2139ee7-f61f-4371-ae4b-38604675081e could not be found. May 16 20:37:02.443347 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:37:02.443347 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:02.443347 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:37:02.443347 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:02.443347 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:37:02.443347 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:37:02.443347 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:37:02.443347 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:37:02.443347 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e2139ee7-f61f-4371-ae4b-38604675081e could not be found. May 16 20:37:02.443347 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:37:02.443347 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-c816ac9d-b9bc-428c-85b9-22d05b99ef46 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Returning 404 to user: Volume e2139ee7-f61f-4371-ae4b-38604675081e could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:37:02.443347 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-c816ac9d-b9bc-428c-85b9-22d05b99ef46 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/e2139ee7-f61f-4371-ae4b-38604675081e" status: 404 len: 109 microversion: 2.1 time: 0.437376 May 16 20:37:02.443347 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 30/54] 10.222.0.49 () {58 vars in 1244 bytes} [Mon May 16 20:37:02 2022] GET /compute/v2.1/os-volumes/e2139ee7-f61f-4371-ae4b-38604675081e => generated 109 bytes in 439 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 20:37:02.459932 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-ba6ebed3-a4da-443b-84c5-6111ec189ff5 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Calling method '.version_select at 0x7f81b25e00d0>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:02.463043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-2d4c5e67-d2e2-4d2b-97fc-528788092691 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:02.471014 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-2d4c5e67-d2e2-4d2b-97fc-528788092691 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1273 microversion: 2.1 time: 0.167337 May 16 20:37:02.476652 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 25/55] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:02 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:37:02.540794 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-66239b3d-e321-45a9-b4e4-19fd3e5d489d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:02.541502 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-66239b3d-e321-45a9-b4e4-19fd3e5d489d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:02.748967 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-66239b3d-e321-45a9-b4e4-19fd3e5d489d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:02.756937 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-66239b3d-e321-45a9-b4e4-19fd3e5d489d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:02.767688 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-66239b3d-e321-45a9-b4e4-19fd3e5d489d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:02.768902 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-66239b3d-e321-45a9-b4e4-19fd3e5d489d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1281 microversion: 2.20 time: 0.232553 May 16 20:37:02.769469 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 26/56] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:02 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1281 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:37:03.016645 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-ba6ebed3-a4da-443b-84c5-6111ec189ff5 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] HTTP exception thrown: Volume e2139ee7-f61f-4371-ae4b-38604675081e could not be found. May 16 20:37:03.023821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-ba6ebed3-a4da-443b-84c5-6111ec189ff5 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Request method failure captured: May 16 20:37:03.023821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: DELETE /compute/v2.1/os-volumes/e2139ee7-f61f-4371-ae4b-38604675081e HTTP/1.1 May 16 20:37:03.023821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:37:03.023821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:37:03.023821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:37:03.023821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:37:03.023821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:37:03.023821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:37:03.023821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:37:03.023821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:37:03.023821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrXf7cT-614ZSX2gHW_e_Lp0LDmQ2Ptn5RfvavpvUMQrvpWTq9O7FmC4b5A32uWTudt0EGwIjmGslsocDxgLZG6aUwAs9WuVCqR9rUzW_NhgnJ0xVYnuCkEMf9yc_W3mIeAjOsPTydiNoubgkb34GjYZmv9ITjURTEB_obq9SDED9S0 May 16 20:37:03.023821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:37:03.023821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:37:03.023821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:37:03.023821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:37:03.023821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:37:03.023821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:37:03.023821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: ff2f097602f64521be30fcac0c86ca14 May 16 20:37:03.023821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-907751259 May 16 20:37:03.023821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:37:03.023821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:37:03.026553 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ff2f097602f64521be30fcac0c86ca14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ff2f097602f64521be30fcac0c86ca14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ff2f097602f64521be30fcac0c86ca14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ff2f097602f64521be30fcac0c86ca14"}]}] May 16 20:37:03.026553 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-VolumesSnapshotsTestJSON-907751259 May 16 20:37:03.026553 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: ff2f097602f64521be30fcac0c86ca14 May 16 20:37:03.026553 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-907751259 May 16 20:37:03.026553 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-VolumesSnapshotsTestJSON-907751259-project May 16 20:37:03.026553 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:37:03.026553 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:37:03.026553 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: bd26cc840b9e480b890ca2c1f662ed4c May 16 20:37:03.026553 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-VolumesSnapshotsTestJSON-907751259-project May 16 20:37:03.026553 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: May 16 20:37:03.026553 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Volume e2139ee7-f61f-4371-ae4b-38604675081e could not be found. May 16 20:37:03.026553 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': 'e2139ee7-f61f-4371-ae4b-38604675081e'} May 16 20:37:03.026553 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:37:03.027883 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:03.027883 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 20:37:03.027883 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 20:37:03.027883 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 20:37:03.027883 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 20:37:03.027883 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 20:37:03.027883 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 20:37:03.027883 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 20:37:03.027883 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 20:37:03.027883 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 20:37:03.027883 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 20:37:03.027883 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 20:37:03.027883 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 20:37:03.027883 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 20:37:03.027883 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 20:37:03.027883 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e2139ee7-f61f-4371-ae4b-38604675081e could not be found. (HTTP 404) (Request-ID: req-5786cc3a-eb5a-4599-9717-86614b21bbb6) May 16 20:37:03.027883 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:37:03.027883 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:03.027883 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:37:03.030313 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:03.030313 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 20:37:03.030313 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 20:37:03.030313 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 20:37:03.030313 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 20:37:03.030313 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 20:37:03.030313 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 20:37:03.030313 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 20:37:03.030313 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 20:37:03.030313 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 20:37:03.030313 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 20:37:03.030313 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 20:37:03.030313 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 20:37:03.030313 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 20:37:03.030313 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 20:37:03.030313 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 20:37:03.030313 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 20:37:03.030313 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 20:37:03.030313 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 20:37:03.033565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 20:37:03.033565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 20:37:03.033565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 20:37:03.033565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 20:37:03.033565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e2139ee7-f61f-4371-ae4b-38604675081e could not be found. May 16 20:37:03.033565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:37:03.033565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:03.033565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:37:03.033565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:03.033565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:37:03.033565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:37:03.033565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:37:03.033565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:37:03.033565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 20:37:03.033565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 20:37:03.033565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:37:03.033565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:37:03.033565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 20:37:03.033565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:37:03.053218 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e2139ee7-f61f-4371-ae4b-38604675081e could not be found. May 16 20:37:03.053218 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:37:03.053218 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:03.053218 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:37:03.053218 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:03.053218 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:37:03.053218 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:37:03.053218 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:37:03.053218 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:37:03.053218 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e2139ee7-f61f-4371-ae4b-38604675081e could not be found. May 16 20:37:03.053218 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:37:03.053218 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-ba6ebed3-a4da-443b-84c5-6111ec189ff5 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Returning 404 to user: Volume e2139ee7-f61f-4371-ae4b-38604675081e could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:37:03.053218 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-ba6ebed3-a4da-443b-84c5-6111ec189ff5 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/e2139ee7-f61f-4371-ae4b-38604675081e" status: 404 len: 109 microversion: 2.1 time: 0.577088 May 16 20:37:03.053218 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 31/57] 10.222.0.49 () {58 vars in 1247 bytes} [Mon May 16 20:37:02 2022] DELETE /compute/v2.1/os-volumes/e2139ee7-f61f-4371-ae4b-38604675081e => generated 109 bytes in 587 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:37:03.056552 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-6928944b-0ba3-48cd-b30b-3d617abd0420 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Calling method '.version_select at 0x7f81b15b8040>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:03.177829 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-5b560744-1612-44aa-9540-e9b926250255 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:03.179391 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-5b560744-1612-44aa-9540-e9b926250255 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:03.474134 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-5b560744-1612-44aa-9540-e9b926250255 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:03.488242 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-5b560744-1612-44aa-9540-e9b926250255 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1240 microversion: 2.1 time: 0.316062 May 16 20:37:03.489153 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 32/58] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:03 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1240 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:03.505619 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-6928944b-0ba3-48cd-b30b-3d617abd0420 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] HTTP exception thrown: Volume e2139ee7-f61f-4371-ae4b-38604675081e could not be found. May 16 20:37:03.509195 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e6c02c5f-0a26-4e3c-a559-de560896c5c8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:03.511382 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-e6c02c5f-0a26-4e3c-a559-de560896c5c8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:03.519209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-6928944b-0ba3-48cd-b30b-3d617abd0420 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Request method failure captured: May 16 20:37:03.519209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: GET /compute/v2.1/os-volumes/e2139ee7-f61f-4371-ae4b-38604675081e HTTP/1.1 May 16 20:37:03.519209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:37:03.519209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:37:03.519209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:37:03.519209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:37:03.519209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:37:03.519209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:37:03.519209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:37:03.519209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:37:03.519209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrXf7cT-614ZSX2gHW_e_Lp0LDmQ2Ptn5RfvavpvUMQrvpWTq9O7FmC4b5A32uWTudt0EGwIjmGslsocDxgLZG6aUwAs9WuVCqR9rUzW_NhgnJ0xVYnuCkEMf9yc_W3mIeAjOsPTydiNoubgkb34GjYZmv9ITjURTEB_obq9SDED9S0 May 16 20:37:03.519209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:37:03.519209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:37:03.519209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:37:03.519209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:37:03.519209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:37:03.519209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:37:03.519209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: ff2f097602f64521be30fcac0c86ca14 May 16 20:37:03.519209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-907751259 May 16 20:37:03.519209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:37:03.519209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:37:03.520343 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ff2f097602f64521be30fcac0c86ca14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ff2f097602f64521be30fcac0c86ca14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ff2f097602f64521be30fcac0c86ca14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ff2f097602f64521be30fcac0c86ca14"}]}] May 16 20:37:03.520343 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-VolumesSnapshotsTestJSON-907751259 May 16 20:37:03.520343 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: ff2f097602f64521be30fcac0c86ca14 May 16 20:37:03.520343 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-907751259 May 16 20:37:03.520343 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-VolumesSnapshotsTestJSON-907751259-project May 16 20:37:03.520343 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:37:03.520343 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:37:03.520343 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: bd26cc840b9e480b890ca2c1f662ed4c May 16 20:37:03.520343 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-VolumesSnapshotsTestJSON-907751259-project May 16 20:37:03.520343 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: May 16 20:37:03.520343 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Volume e2139ee7-f61f-4371-ae4b-38604675081e could not be found. May 16 20:37:03.520343 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': 'e2139ee7-f61f-4371-ae4b-38604675081e'} May 16 20:37:03.520343 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:37:03.521020 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:03.521020 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 20:37:03.521020 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 20:37:03.521020 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 20:37:03.521020 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 20:37:03.521020 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 20:37:03.521020 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 20:37:03.521020 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 20:37:03.521020 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 20:37:03.521020 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 20:37:03.521020 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 20:37:03.521020 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 20:37:03.521020 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 20:37:03.521020 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 20:37:03.521020 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 20:37:03.521020 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e2139ee7-f61f-4371-ae4b-38604675081e could not be found. (HTTP 404) (Request-ID: req-314cba02-0a43-4528-95ba-011905be81d0) May 16 20:37:03.521020 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:03.521020 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:03.521020 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:03.521938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:03.521938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 20:37:03.521938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 20:37:03.521938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 20:37:03.521938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 20:37:03.521938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 20:37:03.521938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 20:37:03.521938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 20:37:03.521938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 20:37:03.521938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 20:37:03.521938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 20:37:03.521938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 20:37:03.521938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 20:37:03.521938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 20:37:03.521938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 20:37:03.521938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 20:37:03.521938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 20:37:03.521938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 20:37:03.521938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 20:37:03.523756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 20:37:03.523756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 20:37:03.523756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 20:37:03.523756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 20:37:03.523756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e2139ee7-f61f-4371-ae4b-38604675081e could not be found. May 16 20:37:03.523756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:03.523756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:03.523756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:03.523756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:03.523756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:37:03.523756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:37:03.523756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:37:03.523756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:37:03.523756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 20:37:03.523756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 20:37:03.523756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:37:03.523756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:37:03.523756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 20:37:03.523756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:37:03.526437 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e2139ee7-f61f-4371-ae4b-38604675081e could not be found. May 16 20:37:03.526437 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:03.526437 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:03.526437 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:03.526437 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:03.526437 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:37:03.526437 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:37:03.526437 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:37:03.526437 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:37:03.526437 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e2139ee7-f61f-4371-ae4b-38604675081e could not be found. May 16 20:37:03.526437 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:03.530505 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-6928944b-0ba3-48cd-b30b-3d617abd0420 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] Returning 404 to user: Volume e2139ee7-f61f-4371-ae4b-38604675081e could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:37:03.539229 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-6928944b-0ba3-48cd-b30b-3d617abd0420 tempest-VolumesSnapshotsTestJSON-907751259 tempest-VolumesSnapshotsTestJSON-907751259-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/e2139ee7-f61f-4371-ae4b-38604675081e" status: 404 len: 109 microversion: 2.1 time: 0.497874 May 16 20:37:03.541952 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e6c02c5f-0a26-4e3c-a559-de560896c5c8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:03.542462 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e6c02c5f-0a26-4e3c-a559-de560896c5c8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:03.543305 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 27/59] 10.222.0.49 () {58 vars in 1244 bytes} [Mon May 16 20:37:03 2022] GET /compute/v2.1/os-volumes/e2139ee7-f61f-4371-ae4b-38604675081e => generated 109 bytes in 506 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:37:03.566439 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e6c02c5f-0a26-4e3c-a559-de560896c5c8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:03.567020 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e6c02c5f-0a26-4e3c-a559-de560896c5c8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:03.788554 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-bfca0708-a145-4e8b-b0a2-ba348950c590 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:03.789686 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-bfca0708-a145-4e8b-b0a2-ba348950c590 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:03.799243 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-bfca0708-a145-4e8b-b0a2-ba348950c590 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:03.805291 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-bfca0708-a145-4e8b-b0a2-ba348950c590 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:03.808477 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-bfca0708-a145-4e8b-b0a2-ba348950c590 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:03.809370 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-bfca0708-a145-4e8b-b0a2-ba348950c590 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:04.084769 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-bfca0708-a145-4e8b-b0a2-ba348950c590 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:04.098987 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-bfca0708-a145-4e8b-b0a2-ba348950c590 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:04.104123 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-bfca0708-a145-4e8b-b0a2-ba348950c590 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:04.109493 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-bfca0708-a145-4e8b-b0a2-ba348950c590 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1333 microversion: 2.20 time: 0.325045 May 16 20:37:04.110314 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 28/60] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:03 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1333 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:37:04.405651 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e6c02c5f-0a26-4e3c-a559-de560896c5c8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:04.424426 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-e6c02c5f-0a26-4e3c-a559-de560896c5c8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1315 microversion: 2.1 time: 0.924409 May 16 20:37:04.428803 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 33/61] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:03 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1315 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:04.508516 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-01d4a8a9-bfd5-4d00-bb6f-3700dee7537d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:04.509459 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-01d4a8a9-bfd5-4d00-bb6f-3700dee7537d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:04.527196 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-01d4a8a9-bfd5-4d00-bb6f-3700dee7537d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:04.532199 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-01d4a8a9-bfd5-4d00-bb6f-3700dee7537d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:04.539436 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-01d4a8a9-bfd5-4d00-bb6f-3700dee7537d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:04.541466 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-01d4a8a9-bfd5-4d00-bb6f-3700dee7537d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:04.729735 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-01d4a8a9-bfd5-4d00-bb6f-3700dee7537d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:04.743640 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-01d4a8a9-bfd5-4d00-bb6f-3700dee7537d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1292 microversion: 2.1 time: 0.241343 May 16 20:37:04.744986 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 29/62] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:04 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1292 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:05.131087 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-9d19459e-5fa9-4061-88e9-56b16b4d82f1 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:05.131858 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-9d19459e-5fa9-4061-88e9-56b16b4d82f1 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:05.147005 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9d19459e-5fa9-4061-88e9-56b16b4d82f1 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:05.149703 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9d19459e-5fa9-4061-88e9-56b16b4d82f1 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:05.150624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9d19459e-5fa9-4061-88e9-56b16b4d82f1 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:05.151114 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9d19459e-5fa9-4061-88e9-56b16b4d82f1 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:05.447420 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-35bd31b6-c2c1-4378-b694-73d5801e9aa9 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:05.449906 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-35bd31b6-c2c1-4378-b694-73d5801e9aa9 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:05.476352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-35bd31b6-c2c1-4378-b694-73d5801e9aa9 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:05.476946 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-35bd31b6-c2c1-4378-b694-73d5801e9aa9 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:05.478002 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-35bd31b6-c2c1-4378-b694-73d5801e9aa9 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:05.478499 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-35bd31b6-c2c1-4378-b694-73d5801e9aa9 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:05.479380 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-9d19459e-5fa9-4061-88e9-56b16b4d82f1 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:05.492036 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-9d19459e-5fa9-4061-88e9-56b16b4d82f1 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:05.497145 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-9d19459e-5fa9-4061-88e9-56b16b4d82f1 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:05.498304 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-9d19459e-5fa9-4061-88e9-56b16b4d82f1 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1351 microversion: 2.20 time: 0.371466 May 16 20:37:05.498863 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 34/63] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:05 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1351 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:37:05.765149 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-638100f4-76f5-44e6-9dd8-dc3b57484b64 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:05.766042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-638100f4-76f5-44e6-9dd8-dc3b57484b64 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:05.781625 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-638100f4-76f5-44e6-9dd8-dc3b57484b64 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:05.782543 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-638100f4-76f5-44e6-9dd8-dc3b57484b64 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:05.786679 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-638100f4-76f5-44e6-9dd8-dc3b57484b64 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:05.789741 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-638100f4-76f5-44e6-9dd8-dc3b57484b64 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:06.023688 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-638100f4-76f5-44e6-9dd8-dc3b57484b64 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:06.043006 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-638100f4-76f5-44e6-9dd8-dc3b57484b64 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1298 microversion: 2.1 time: 0.283994 May 16 20:37:06.043818 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 35/64] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:05 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1298 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:06.196954 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-35bd31b6-c2c1-4378-b694-73d5801e9aa9 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:06.209937 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-35bd31b6-c2c1-4378-b694-73d5801e9aa9 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1315 microversion: 2.1 time: 0.769243 May 16 20:37:06.210808 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 30/65] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:05 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1315 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:37:06.518621 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a4e29114-88c9-4fc7-b4af-9305dd6b1d71 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:06.520459 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-a4e29114-88c9-4fc7-b4af-9305dd6b1d71 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:06.538997 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a4e29114-88c9-4fc7-b4af-9305dd6b1d71 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:06.540075 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a4e29114-88c9-4fc7-b4af-9305dd6b1d71 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:06.541207 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a4e29114-88c9-4fc7-b4af-9305dd6b1d71 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:06.541980 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a4e29114-88c9-4fc7-b4af-9305dd6b1d71 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:06.791452 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a4e29114-88c9-4fc7-b4af-9305dd6b1d71 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:06.806190 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a4e29114-88c9-4fc7-b4af-9305dd6b1d71 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:06.812105 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a4e29114-88c9-4fc7-b4af-9305dd6b1d71 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:06.816485 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-a4e29114-88c9-4fc7-b4af-9305dd6b1d71 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1339 microversion: 2.20 time: 0.303229 May 16 20:37:06.818368 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 36/66] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:06 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1339 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:37:07.063274 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-403ee9b3-571f-4e66-a707-32948b4f582b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:07.066738 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-403ee9b3-571f-4e66-a707-32948b4f582b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:07.077144 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-403ee9b3-571f-4e66-a707-32948b4f582b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:07.077826 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-403ee9b3-571f-4e66-a707-32948b4f582b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:07.078909 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-403ee9b3-571f-4e66-a707-32948b4f582b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:07.086715 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-403ee9b3-571f-4e66-a707-32948b4f582b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:07.291001 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-403ee9b3-571f-4e66-a707-32948b4f582b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:07.303402 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-403ee9b3-571f-4e66-a707-32948b4f582b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1298 microversion: 2.1 time: 0.245597 May 16 20:37:07.306607 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 31/67] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:07 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1298 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:07.344982 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-03dee041-9b48-415e-99b0-1e732c35ff7f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:07.344982 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-03dee041-9b48-415e-99b0-1e732c35ff7f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:07.351188 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-03dee041-9b48-415e-99b0-1e732c35ff7f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:07.351910 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-03dee041-9b48-415e-99b0-1e732c35ff7f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:07.353626 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-03dee041-9b48-415e-99b0-1e732c35ff7f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:07.354556 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-03dee041-9b48-415e-99b0-1e732c35ff7f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:07.442035 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-2a22e4e1-0647-4678-9aae-3eb2bcf82954 req-d086f9b1-6c6a-4c4a-8269-9ecb11c8ab26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "952d1913-9e82-4b2c-b4b5-3edf96b62106", "tag": "04948340-2c71-481a-9c29-71b06aca8082"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:37:07.464289 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-2a22e4e1-0647-4678-9aae-3eb2bcf82954 req-d086f9b1-6c6a-4c4a-8269-9ecb11c8ab26 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:07.466548 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-2a22e4e1-0647-4678-9aae-3eb2bcf82954 req-d086f9b1-6c6a-4c4a-8269-9ecb11c8ab26 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:07.530213 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-2a22e4e1-0647-4678-9aae-3eb2bcf82954 req-d086f9b1-6c6a-4c4a-8269-9ecb11c8ab26 service nova] Creating event network-changed:04948340-2c71-481a-9c29-71b06aca8082 for instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 on hv-cinder-77703 May 16 20:37:07.533808 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-2a22e4e1-0647-4678-9aae-3eb2bcf82954 req-d086f9b1-6c6a-4c4a-8269-9ecb11c8ab26 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123564) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 16 20:37:07.539632 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-46b2745c-3340-4847-98b0-5c6ec0a8f156 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:07.543393 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-46b2745c-3340-4847-98b0-5c6ec0a8f156 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:07.546183 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-46b2745c-3340-4847-98b0-5c6ec0a8f156 None None] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:07.549082 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-46b2745c-3340-4847-98b0-5c6ec0a8f156 None None] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:07.589497 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.compute.rpcapi [None req-46b2745c-3340-4847-98b0-5c6ec0a8f156 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 16 20:37:07.590431 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-46b2745c-3340-4847-98b0-5c6ec0a8f156 None None] Releasing lock "compute-rpcapi-router" {{(pid=123564) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 16 20:37:07.636349 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-46b2745c-3340-4847-98b0-5c6ec0a8f156 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.471910 May 16 20:37:07.638374 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 37/68] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:37:07.836072 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-04d15581-9f47-44d1-bf50-39d0cd970e80 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:07.837401 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-04d15581-9f47-44d1-bf50-39d0cd970e80 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:07.875540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-04d15581-9f47-44d1-bf50-39d0cd970e80 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:07.880729 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-04d15581-9f47-44d1-bf50-39d0cd970e80 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:07.895036 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-04d15581-9f47-44d1-bf50-39d0cd970e80 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:07.900252 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-04d15581-9f47-44d1-bf50-39d0cd970e80 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:08.103193 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-04d15581-9f47-44d1-bf50-39d0cd970e80 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:08.125056 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-04d15581-9f47-44d1-bf50-39d0cd970e80 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:08.134086 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-04d15581-9f47-44d1-bf50-39d0cd970e80 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:08.139014 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-04d15581-9f47-44d1-bf50-39d0cd970e80 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1339 microversion: 2.20 time: 0.305447 May 16 20:37:08.140782 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 38/69] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:07 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1339 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:37:08.216347 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-03dee041-9b48-415e-99b0-1e732c35ff7f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:08.231003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-03dee041-9b48-415e-99b0-1e732c35ff7f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1315 microversion: 2.1 time: 0.921363 May 16 20:37:08.239498 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 32/70] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:07 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1315 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:08.328338 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-47eed9b6-f900-4c33-b9e5-005e46258fb8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:08.329383 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-47eed9b6-f900-4c33-b9e5-005e46258fb8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:08.343550 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-47eed9b6-f900-4c33-b9e5-005e46258fb8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:08.345047 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-47eed9b6-f900-4c33-b9e5-005e46258fb8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:08.348874 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-47eed9b6-f900-4c33-b9e5-005e46258fb8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:08.349664 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-47eed9b6-f900-4c33-b9e5-005e46258fb8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:09.159212 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-8c383352-027f-481a-a348-f4107f985f13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:09.160199 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-8c383352-027f-481a-a348-f4107f985f13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:09.178866 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8c383352-027f-481a-a348-f4107f985f13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:09.180429 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8c383352-027f-481a-a348-f4107f985f13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:09.185060 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8c383352-027f-481a-a348-f4107f985f13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:09.187709 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8c383352-027f-481a-a348-f4107f985f13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:09.324397 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-47eed9b6-f900-4c33-b9e5-005e46258fb8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:09.338127 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-47eed9b6-f900-4c33-b9e5-005e46258fb8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1366 microversion: 2.1 time: 1.016412 May 16 20:37:09.338995 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 39/71] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:08 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1366 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:09.351484 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-1953ca97-ff14-4e93-9c89-8ac92a83d418 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:09.352103 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-1953ca97-ff14-4e93-9c89-8ac92a83d418 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:09.380722 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1953ca97-ff14-4e93-9c89-8ac92a83d418 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:09.381197 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1953ca97-ff14-4e93-9c89-8ac92a83d418 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:09.382028 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1953ca97-ff14-4e93-9c89-8ac92a83d418 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:09.382480 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1953ca97-ff14-4e93-9c89-8ac92a83d418 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:10.080976 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-8c383352-027f-481a-a348-f4107f985f13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:10.101837 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-8c383352-027f-481a-a348-f4107f985f13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:10.108322 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-8c383352-027f-481a-a348-f4107f985f13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:10.114106 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-8c383352-027f-481a-a348-f4107f985f13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1406 microversion: 2.20 time: 0.956817 May 16 20:37:10.115008 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 33/72] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:09 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1406 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:37:10.187064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-1953ca97-ff14-4e93-9c89-8ac92a83d418 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:10.199560 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-1953ca97-ff14-4e93-9c89-8ac92a83d418 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1315 microversion: 2.1 time: 0.858915 May 16 20:37:10.200582 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 40/73] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:09 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1315 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:10.327983 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-bee86089-7d65-43db-9064-538e1ce06d64 tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] Action: 'create', calling method: .version_select at 0x7f81b15abdc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-41765869", "metadata": {"Type": "work"}}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:37:10.355043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-bee86089-7d65-43db-9064-538e1ce06d64 tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] Request method failure captured: May 16 20:37:10.355043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 20:37:10.355043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:37:10.355043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:37:10.355043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:37:10.355043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 120 May 16 20:37:10.355043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:37:10.355043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:37:10.355043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:37:10.355043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:37:10.355043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrX134ViKQG8OSwmhj8h2BwI3BFpJity2nbwFH2OXFF3ppMTYECMIShRKNp9vc7TFjxDTSCSbPw2wgNk3uaPwa0aZLhTlZKY39HOYjFY3qMpjeNs5B5x7tTmpPMmxSsGtKRg-UwOxjk6Wx_ovyLmS9fKKZ_lFmVFr-E19ncB5jR77RI May 16 20:37:10.355043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:37:10.355043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:37:10.355043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:37:10.355043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:37:10.355043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:37:10.355043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:37:10.355043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 19972a48759f4069a2c855f9f7f829e4 May 16 20:37:10.355043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-VolumesNegativeTest-1131891558 May 16 20:37:10.355043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:37:10.355043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:37:10.356542 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_19972a48759f4069a2c855f9f7f829e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19972a48759f4069a2c855f9f7f829e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/19972a48759f4069a2c855f9f7f829e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19972a48759f4069a2c855f9f7f829e4"}]}] May 16 20:37:10.356542 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-VolumesNegativeTest-1131891558 May 16 20:37:10.356542 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 19972a48759f4069a2c855f9f7f829e4 May 16 20:37:10.356542 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-VolumesNegativeTest-1131891558 May 16 20:37:10.356542 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-VolumesNegativeTest-1131891558-project May 16 20:37:10.356542 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:37:10.356542 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:37:10.356542 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: 8feec28b3f09416facb89d4a5a77d0a5 May 16 20:37:10.356542 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-VolumesNegativeTest-1131891558-project May 16 20:37:10.356542 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: May 16 20:37:10.356542 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-41765869", "metadata": {"Type": "work"}}} May 16 20:37:10.356542 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: May 16 20:37:10.356542 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-41765869', 'metadata': {'Type': 'work'}}}} May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise error May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi '#$%' May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:37:10.357351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:37:10.358504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 20:37:10.358504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 20:37:10.358504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:37:10.358504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:37:10.358504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 20:37:10.358504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 20:37:10.358504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 20:37:10.358504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 20:37:10.358504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 20:37:10.358504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 20:37:10.358504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 20:37:10.358504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.358504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:10.358504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.358504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:10.358504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:37:10.358504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:37:10.358504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 20:37:10.358504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 20:37:10.360672 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 20:37:10.360672 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.360672 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-bee86089-7d65-43db-9064-538e1ce06d64 tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:37:10.360672 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-bee86089-7d65-43db-9064-538e1ce06d64 tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.241131 May 16 20:37:10.360672 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 34/74] 10.222.0.49 () {60 vars in 1155 bytes} [Mon May 16 20:37:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 243 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 20:37:10.361753 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-2a8494c5-81d6-41e5-a03f-f288e326fa91 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:10.362472 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-2a8494c5-81d6-41e5-a03f-f288e326fa91 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:10.381714 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-665d4584-b9a2-4d97-9727-13634c761158 tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] Action: 'create', calling method: .version_select at 0x7f81b1539550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1377501554", "metadata": {"Type": "work"}}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:37:10.388278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-665d4584-b9a2-4d97-9727-13634c761158 tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] Request method failure captured: May 16 20:37:10.388278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 20:37:10.388278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:37:10.388278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:37:10.388278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:37:10.388278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 120 May 16 20:37:10.388278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:37:10.388278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:37:10.388278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:37:10.388278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:37:10.388278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrX134ViKQG8OSwmhj8h2BwI3BFpJity2nbwFH2OXFF3ppMTYECMIShRKNp9vc7TFjxDTSCSbPw2wgNk3uaPwa0aZLhTlZKY39HOYjFY3qMpjeNs5B5x7tTmpPMmxSsGtKRg-UwOxjk6Wx_ovyLmS9fKKZ_lFmVFr-E19ncB5jR77RI May 16 20:37:10.388278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:37:10.388278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:37:10.388278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:37:10.388278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:37:10.388278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:37:10.388278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:37:10.388278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 19972a48759f4069a2c855f9f7f829e4 May 16 20:37:10.388278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-VolumesNegativeTest-1131891558 May 16 20:37:10.388278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:37:10.388278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:37:10.389735 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_19972a48759f4069a2c855f9f7f829e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19972a48759f4069a2c855f9f7f829e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/19972a48759f4069a2c855f9f7f829e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19972a48759f4069a2c855f9f7f829e4"}]}] May 16 20:37:10.389735 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-VolumesNegativeTest-1131891558 May 16 20:37:10.389735 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 19972a48759f4069a2c855f9f7f829e4 May 16 20:37:10.389735 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-VolumesNegativeTest-1131891558 May 16 20:37:10.389735 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-VolumesNegativeTest-1131891558-project May 16 20:37:10.389735 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:37:10.389735 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:37:10.389735 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: 8feec28b3f09416facb89d4a5a77d0a5 May 16 20:37:10.389735 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-VolumesNegativeTest-1131891558-project May 16 20:37:10.389735 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: May 16 20:37:10.389735 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1377501554", "metadata": {"Type": "work"}}} May 16 20:37:10.389735 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: May 16 20:37:10.389735 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1377501554', 'metadata': {'Type': 'work'}}}} May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise error May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi '0' May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:37:10.390568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:37:10.392958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 20:37:10.392958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 20:37:10.392958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:37:10.392958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:37:10.392958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 20:37:10.392958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 20:37:10.392958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 20:37:10.392958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 20:37:10.392958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 20:37:10.392958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 20:37:10.392958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 20:37:10.392958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.392958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:10.392958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.392958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:10.392958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:37:10.392958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:37:10.392958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 20:37:10.392958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 20:37:10.395126 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 20:37:10.395126 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.401797 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-665d4584-b9a2-4d97-9727-13634c761158 tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:37:10.418227 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2a8494c5-81d6-41e5-a03f-f288e326fa91 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:10.418486 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-665d4584-b9a2-4d97-9727-13634c761158 tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.036935 May 16 20:37:10.420145 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2a8494c5-81d6-41e5-a03f-f288e326fa91 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:10.421006 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 35/75] 10.222.0.49 () {60 vars in 1155 bytes} [Mon May 16 20:37:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 16 20:37:10.423108 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2a8494c5-81d6-41e5-a03f-f288e326fa91 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:10.424957 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2a8494c5-81d6-41e5-a03f-f288e326fa91 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:10.446801 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7ef377b4-3048-4a28-9e06-f23813b32604 tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] Action: 'create', calling method: .version_select at 0x7f81b1539700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1332953329", "metadata": {"Type": "work"}}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:37:10.451567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7ef377b4-3048-4a28-9e06-f23813b32604 tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] Request method failure captured: May 16 20:37:10.451567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 20:37:10.451567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:37:10.451567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:37:10.451567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:37:10.451567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 119 May 16 20:37:10.451567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:37:10.451567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:37:10.451567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:37:10.451567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:37:10.451567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrX134ViKQG8OSwmhj8h2BwI3BFpJity2nbwFH2OXFF3ppMTYECMIShRKNp9vc7TFjxDTSCSbPw2wgNk3uaPwa0aZLhTlZKY39HOYjFY3qMpjeNs5B5x7tTmpPMmxSsGtKRg-UwOxjk6Wx_ovyLmS9fKKZ_lFmVFr-E19ncB5jR77RI May 16 20:37:10.451567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:37:10.451567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:37:10.451567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:37:10.451567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:37:10.451567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:37:10.451567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:37:10.451567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 19972a48759f4069a2c855f9f7f829e4 May 16 20:37:10.451567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-VolumesNegativeTest-1131891558 May 16 20:37:10.451567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:37:10.451567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:37:10.453055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_19972a48759f4069a2c855f9f7f829e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19972a48759f4069a2c855f9f7f829e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/19972a48759f4069a2c855f9f7f829e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19972a48759f4069a2c855f9f7f829e4"}]}] May 16 20:37:10.453055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-VolumesNegativeTest-1131891558 May 16 20:37:10.453055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 19972a48759f4069a2c855f9f7f829e4 May 16 20:37:10.453055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-VolumesNegativeTest-1131891558 May 16 20:37:10.453055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-VolumesNegativeTest-1131891558-project May 16 20:37:10.453055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:37:10.453055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:37:10.453055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: 8feec28b3f09416facb89d4a5a77d0a5 May 16 20:37:10.453055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-VolumesNegativeTest-1131891558-project May 16 20:37:10.453055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: May 16 20:37:10.453055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1332953329", "metadata": {"Type": "work"}}} May 16 20:37:10.453055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: May 16 20:37:10.453055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1332953329', 'metadata': {'Type': 'work'}}}} May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise error May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi '' May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:37:10.453727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:37:10.454929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 20:37:10.454929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 20:37:10.454929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:37:10.454929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:37:10.454929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 20:37:10.454929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 20:37:10.454929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 20:37:10.454929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 20:37:10.454929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 20:37:10.454929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 20:37:10.454929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 20:37:10.454929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.454929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:10.454929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.454929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:10.454929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:37:10.454929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:37:10.454929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 20:37:10.454929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 20:37:10.456224 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 20:37:10.456224 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.459170 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7ef377b4-3048-4a28-9e06-f23813b32604 tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:37:10.463248 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-7ef377b4-3048-4a28-9e06-f23813b32604 tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.028124 May 16 20:37:10.464249 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 36/76] 10.222.0.49 () {60 vars in 1155 bytes} [Mon May 16 20:37:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 20:37:10.502270 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0ea7221a-41f0-4229-b098-ee808f7908ec tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] Calling method '.version_select at 0x7f81b15495e0>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:10.603173 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-0ea7221a-41f0-4229-b098-ee808f7908ec tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] HTTP exception thrown: Volume tempest-invalid-1144618840 could not be found. May 16 20:37:10.606706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0ea7221a-41f0-4229-b098-ee808f7908ec tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] Request method failure captured: May 16 20:37:10.606706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1144618840 HTTP/1.1 May 16 20:37:10.606706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:37:10.606706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:37:10.606706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:37:10.606706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:37:10.606706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:37:10.606706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:37:10.606706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:37:10.606706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:37:10.606706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrX134ViKQG8OSwmhj8h2BwI3BFpJity2nbwFH2OXFF3ppMTYECMIShRKNp9vc7TFjxDTSCSbPw2wgNk3uaPwa0aZLhTlZKY39HOYjFY3qMpjeNs5B5x7tTmpPMmxSsGtKRg-UwOxjk6Wx_ovyLmS9fKKZ_lFmVFr-E19ncB5jR77RI May 16 20:37:10.606706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:37:10.606706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:37:10.606706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:37:10.606706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:37:10.606706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:37:10.606706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:37:10.606706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 19972a48759f4069a2c855f9f7f829e4 May 16 20:37:10.606706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-VolumesNegativeTest-1131891558 May 16 20:37:10.606706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:37:10.606706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:37:10.608024 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_19972a48759f4069a2c855f9f7f829e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19972a48759f4069a2c855f9f7f829e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/19972a48759f4069a2c855f9f7f829e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19972a48759f4069a2c855f9f7f829e4"}]}] May 16 20:37:10.608024 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-VolumesNegativeTest-1131891558 May 16 20:37:10.608024 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 19972a48759f4069a2c855f9f7f829e4 May 16 20:37:10.608024 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-VolumesNegativeTest-1131891558 May 16 20:37:10.608024 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-VolumesNegativeTest-1131891558-project May 16 20:37:10.608024 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:37:10.608024 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:37:10.608024 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: 8feec28b3f09416facb89d4a5a77d0a5 May 16 20:37:10.608024 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-VolumesNegativeTest-1131891558-project May 16 20:37:10.608024 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: May 16 20:37:10.608024 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Volume tempest-invalid-1144618840 could not be found. May 16 20:37:10.608024 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': 'tempest-invalid-1144618840'} May 16 20:37:10.608024 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:37:10.608757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:10.608757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 20:37:10.608757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 20:37:10.608757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 20:37:10.608757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 20:37:10.608757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 20:37:10.608757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 20:37:10.608757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 20:37:10.608757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 20:37:10.608757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 20:37:10.608757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 20:37:10.608757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 20:37:10.608757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 20:37:10.608757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 20:37:10.608757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 20:37:10.608757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1144618840 could not be found. (HTTP 404) (Request-ID: req-60f75b48-e3b9-4309-8e4a-9ebc056f15c6) May 16 20:37:10.608757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.608757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:10.608757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.609840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:10.609840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 20:37:10.609840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 20:37:10.609840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 20:37:10.609840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 20:37:10.609840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 20:37:10.609840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 20:37:10.609840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 20:37:10.609840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 20:37:10.609840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 20:37:10.609840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 20:37:10.609840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 20:37:10.609840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 20:37:10.609840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 20:37:10.609840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 20:37:10.609840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 20:37:10.609840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 20:37:10.609840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 20:37:10.609840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 20:37:10.611049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 20:37:10.611049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 20:37:10.611049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 20:37:10.611049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 20:37:10.611049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1144618840 could not be found. May 16 20:37:10.611049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.611049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:10.611049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.611049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:10.611049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:37:10.611049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:37:10.611049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:37:10.611049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:37:10.611049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 20:37:10.611049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 20:37:10.611049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:37:10.611049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:37:10.611049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 20:37:10.611049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:37:10.611049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1144618840 could not be found. May 16 20:37:10.613575 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.613575 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:10.613575 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.613575 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:10.613575 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:37:10.613575 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:37:10.613575 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:37:10.613575 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:37:10.613575 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1144618840 could not be found. May 16 20:37:10.613575 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.617651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0ea7221a-41f0-4229-b098-ee808f7908ec tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] Returning 404 to user: Volume tempest-invalid-1144618840 could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:37:10.618980 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0ea7221a-41f0-4229-b098-ee808f7908ec tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1144618840" status: 404 len: 99 microversion: 2.1 time: 0.136934 May 16 20:37:10.629048 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 37/77] 10.222.0.49 () {58 vars in 1217 bytes} [Mon May 16 20:37:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1144618840 => generated 99 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 16 20:37:10.663576 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-1d0f02e3-9d39-4ea6-95d6-daf95967d4d8 tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.032146 May 16 20:37:10.665152 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 38/78] 10.222.0.49 () {58 vars in 1139 bytes} [Mon May 16 20:37:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 16 20:37:10.683524 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-a32c7cc3-ed79-4ba3-8973-8ec15e7a5de8 tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011333 May 16 20:37:10.684954 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 39/79] 10.222.0.49 () {58 vars in 1136 bytes} [Mon May 16 20:37:10 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 16 20:37:10.698032 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-80ddab99-1cbc-447f-838f-9fb8d31f925d tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] Calling method '.version_select at 0x7f81b1647dc0>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:10.744979 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-80ddab99-1cbc-447f-838f-9fb8d31f925d tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] HTTP exception thrown: Volume 30354a96-1967-422b-85c2-44d235a7b49c could not be found. May 16 20:37:10.747624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-80ddab99-1cbc-447f-838f-9fb8d31f925d tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] Request method failure captured: May 16 20:37:10.747624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: DELETE /compute/v2.1/os-volumes/30354a96-1967-422b-85c2-44d235a7b49c HTTP/1.1 May 16 20:37:10.747624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:37:10.747624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:37:10.747624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:37:10.747624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:37:10.747624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:37:10.747624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:37:10.747624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:37:10.747624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:37:10.747624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrX134ViKQG8OSwmhj8h2BwI3BFpJity2nbwFH2OXFF3ppMTYECMIShRKNp9vc7TFjxDTSCSbPw2wgNk3uaPwa0aZLhTlZKY39HOYjFY3qMpjeNs5B5x7tTmpPMmxSsGtKRg-UwOxjk6Wx_ovyLmS9fKKZ_lFmVFr-E19ncB5jR77RI May 16 20:37:10.747624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:37:10.747624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:37:10.747624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:37:10.747624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:37:10.747624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:37:10.747624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:37:10.747624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 19972a48759f4069a2c855f9f7f829e4 May 16 20:37:10.747624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-VolumesNegativeTest-1131891558 May 16 20:37:10.747624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:37:10.747624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:37:10.748815 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_19972a48759f4069a2c855f9f7f829e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19972a48759f4069a2c855f9f7f829e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/19972a48759f4069a2c855f9f7f829e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19972a48759f4069a2c855f9f7f829e4"}]}] May 16 20:37:10.748815 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-VolumesNegativeTest-1131891558 May 16 20:37:10.748815 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 19972a48759f4069a2c855f9f7f829e4 May 16 20:37:10.748815 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-VolumesNegativeTest-1131891558 May 16 20:37:10.748815 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-VolumesNegativeTest-1131891558-project May 16 20:37:10.748815 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:37:10.748815 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:37:10.748815 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: 8feec28b3f09416facb89d4a5a77d0a5 May 16 20:37:10.748815 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-VolumesNegativeTest-1131891558-project May 16 20:37:10.748815 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: May 16 20:37:10.748815 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Volume 30354a96-1967-422b-85c2-44d235a7b49c could not be found. May 16 20:37:10.748815 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': '30354a96-1967-422b-85c2-44d235a7b49c'} May 16 20:37:10.748815 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:37:10.749517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:10.749517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 20:37:10.749517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 20:37:10.749517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 20:37:10.749517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 20:37:10.749517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 20:37:10.749517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 20:37:10.749517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 20:37:10.749517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 20:37:10.749517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 20:37:10.749517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 20:37:10.749517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 20:37:10.749517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 20:37:10.749517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 20:37:10.749517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 20:37:10.749517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 30354a96-1967-422b-85c2-44d235a7b49c could not be found. (HTTP 404) (Request-ID: req-9281837c-ef1b-4933-ab4d-f3c22e999797) May 16 20:37:10.749517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.749517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:10.749517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.750593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:10.750593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 20:37:10.750593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 20:37:10.750593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 20:37:10.750593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 20:37:10.750593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 20:37:10.750593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 20:37:10.750593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 20:37:10.750593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 20:37:10.750593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 20:37:10.750593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 20:37:10.750593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 20:37:10.750593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 20:37:10.750593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 20:37:10.750593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 20:37:10.750593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 20:37:10.750593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 20:37:10.750593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 20:37:10.750593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 20:37:10.752970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 20:37:10.752970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 20:37:10.752970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 20:37:10.752970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 20:37:10.752970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 30354a96-1967-422b-85c2-44d235a7b49c could not be found. May 16 20:37:10.752970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.752970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:10.752970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.752970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:10.752970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:37:10.752970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:37:10.752970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:37:10.752970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:37:10.752970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 20:37:10.752970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 20:37:10.752970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:37:10.752970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:37:10.752970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 20:37:10.752970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:37:10.755436 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 30354a96-1967-422b-85c2-44d235a7b49c could not be found. May 16 20:37:10.755436 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.755436 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:10.755436 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.755436 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:10.755436 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:37:10.755436 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:37:10.755436 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:37:10.755436 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:37:10.755436 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 30354a96-1967-422b-85c2-44d235a7b49c could not be found. May 16 20:37:10.755436 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.755436 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-80ddab99-1cbc-447f-838f-9fb8d31f925d tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] Returning 404 to user: Volume 30354a96-1967-422b-85c2-44d235a7b49c could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:37:10.755436 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-80ddab99-1cbc-447f-838f-9fb8d31f925d tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/30354a96-1967-422b-85c2-44d235a7b49c" status: 404 len: 109 microversion: 2.1 time: 0.058413 May 16 20:37:10.755436 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 40/80] 10.222.0.49 () {58 vars in 1247 bytes} [Mon May 16 20:37:10 2022] DELETE /compute/v2.1/os-volumes/30354a96-1967-422b-85c2-44d235a7b49c => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:37:10.770867 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7412161a-2be2-4497-842c-35d1d7f650a7 tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] Calling method '.version_select at 0x7f81b15390d0>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:10.884334 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-7412161a-2be2-4497-842c-35d1d7f650a7 tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] HTTP exception thrown: Volume 5170688d-57e1-42a6-a0f1-557e8668c0a1 could not be found. May 16 20:37:10.886713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7412161a-2be2-4497-842c-35d1d7f650a7 tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] Request method failure captured: May 16 20:37:10.886713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: GET /compute/v2.1/os-volumes/5170688d-57e1-42a6-a0f1-557e8668c0a1 HTTP/1.1 May 16 20:37:10.886713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:37:10.886713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:37:10.886713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:37:10.886713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:37:10.886713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:37:10.886713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:37:10.886713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:37:10.886713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:37:10.886713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrX134ViKQG8OSwmhj8h2BwI3BFpJity2nbwFH2OXFF3ppMTYECMIShRKNp9vc7TFjxDTSCSbPw2wgNk3uaPwa0aZLhTlZKY39HOYjFY3qMpjeNs5B5x7tTmpPMmxSsGtKRg-UwOxjk6Wx_ovyLmS9fKKZ_lFmVFr-E19ncB5jR77RI May 16 20:37:10.886713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:37:10.886713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:37:10.886713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:37:10.886713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:37:10.886713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:37:10.886713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:37:10.886713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 19972a48759f4069a2c855f9f7f829e4 May 16 20:37:10.886713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-VolumesNegativeTest-1131891558 May 16 20:37:10.886713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:37:10.886713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:37:10.888345 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_19972a48759f4069a2c855f9f7f829e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19972a48759f4069a2c855f9f7f829e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/19972a48759f4069a2c855f9f7f829e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19972a48759f4069a2c855f9f7f829e4"}]}] May 16 20:37:10.888345 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-VolumesNegativeTest-1131891558 May 16 20:37:10.888345 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 19972a48759f4069a2c855f9f7f829e4 May 16 20:37:10.888345 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-VolumesNegativeTest-1131891558 May 16 20:37:10.888345 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-VolumesNegativeTest-1131891558-project May 16 20:37:10.888345 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:37:10.888345 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:37:10.888345 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: 8feec28b3f09416facb89d4a5a77d0a5 May 16 20:37:10.888345 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-VolumesNegativeTest-1131891558-project May 16 20:37:10.888345 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: May 16 20:37:10.888345 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Volume 5170688d-57e1-42a6-a0f1-557e8668c0a1 could not be found. May 16 20:37:10.888345 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': '5170688d-57e1-42a6-a0f1-557e8668c0a1'} May 16 20:37:10.888345 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:37:10.889235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:10.889235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 20:37:10.889235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 20:37:10.889235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 20:37:10.889235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 20:37:10.889235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 20:37:10.889235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 20:37:10.889235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 20:37:10.889235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 20:37:10.889235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 20:37:10.889235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 20:37:10.889235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 20:37:10.889235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 20:37:10.889235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 20:37:10.889235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 20:37:10.889235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5170688d-57e1-42a6-a0f1-557e8668c0a1 could not be found. (HTTP 404) (Request-ID: req-e9e2d352-53ba-4b13-88d8-12f397373845) May 16 20:37:10.889235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.889235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:10.889235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.890215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:10.890215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 20:37:10.890215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 20:37:10.890215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 20:37:10.890215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 20:37:10.890215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 20:37:10.890215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 20:37:10.890215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 20:37:10.890215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 20:37:10.890215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 20:37:10.890215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 20:37:10.890215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 20:37:10.890215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 20:37:10.890215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 20:37:10.890215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 20:37:10.890215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 20:37:10.890215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 20:37:10.890215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 20:37:10.890215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 20:37:10.891700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 20:37:10.891700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 20:37:10.891700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 20:37:10.891700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 20:37:10.891700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5170688d-57e1-42a6-a0f1-557e8668c0a1 could not be found. May 16 20:37:10.891700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.891700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:10.891700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.891700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:10.891700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:37:10.891700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:37:10.891700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:37:10.891700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:37:10.891700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 20:37:10.891700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 20:37:10.891700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:37:10.891700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:37:10.891700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 20:37:10.891700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:37:10.896280 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5170688d-57e1-42a6-a0f1-557e8668c0a1 could not be found. May 16 20:37:10.896280 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.896280 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:37:10.896280 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.896280 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:37:10.896280 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:37:10.896280 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:37:10.896280 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:37:10.896280 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:37:10.896280 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5170688d-57e1-42a6-a0f1-557e8668c0a1 could not be found. May 16 20:37:10.896280 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:37:10.896280 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7412161a-2be2-4497-842c-35d1d7f650a7 tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] Returning 404 to user: Volume 5170688d-57e1-42a6-a0f1-557e8668c0a1 could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:37:10.896280 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-7412161a-2be2-4497-842c-35d1d7f650a7 tempest-VolumesNegativeTest-1131891558 tempest-VolumesNegativeTest-1131891558-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/5170688d-57e1-42a6-a0f1-557e8668c0a1" status: 404 len: 109 microversion: 2.1 time: 0.131138 May 16 20:37:10.896280 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 41/81] 10.222.0.49 () {58 vars in 1244 bytes} [Mon May 16 20:37:10 2022] GET /compute/v2.1/os-volumes/5170688d-57e1-42a6-a0f1-557e8668c0a1 => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:37:11.132337 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-6f62f751-5c33-40bd-a5ab-5307a22aeb7b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:11.133104 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-6f62f751-5c33-40bd-a5ab-5307a22aeb7b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:11.144726 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6f62f751-5c33-40bd-a5ab-5307a22aeb7b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:11.149642 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6f62f751-5c33-40bd-a5ab-5307a22aeb7b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:11.152829 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6f62f751-5c33-40bd-a5ab-5307a22aeb7b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:11.153984 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6f62f751-5c33-40bd-a5ab-5307a22aeb7b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:11.523069 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2a8494c5-81d6-41e5-a03f-f288e326fa91 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:11.530756 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-2a8494c5-81d6-41e5-a03f-f288e326fa91 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1366 microversion: 2.1 time: 1.177169 May 16 20:37:11.531345 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 41/82] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:10 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1366 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:11.536205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-5a072a35-2f30-4d63-ae19-2e69fb18ab9c req-64e68088-64f9-4e03-9ffe-0b1f586c763e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f8d450f-828f-4002-b649-ff13d14a047c", "tag": "6aa491fa-5223-4d44-b9ca-f8811045b0ad"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:37:11.546814 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-5a072a35-2f30-4d63-ae19-2e69fb18ab9c req-64e68088-64f9-4e03-9ffe-0b1f586c763e service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:11.547327 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-5a072a35-2f30-4d63-ae19-2e69fb18ab9c req-64e68088-64f9-4e03-9ffe-0b1f586c763e service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:11.559551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-5a072a35-2f30-4d63-ae19-2e69fb18ab9c req-64e68088-64f9-4e03-9ffe-0b1f586c763e service nova] Creating event network-changed:6aa491fa-5223-4d44-b9ca-f8811045b0ad for instance 6f8d450f-828f-4002-b649-ff13d14a047c on hv-cinder-77703 May 16 20:37:11.565081 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-5a072a35-2f30-4d63-ae19-2e69fb18ab9c req-64e68088-64f9-4e03-9ffe-0b1f586c763e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032151 May 16 20:37:11.565976 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 42/83] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:37:11.571787 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-aa73aa40-098b-47e6-837a-ccf5f90b0870 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:11.574658 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-aa73aa40-098b-47e6-837a-ccf5f90b0870 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:11.581979 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-aa73aa40-098b-47e6-837a-ccf5f90b0870 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:11.582645 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-aa73aa40-098b-47e6-837a-ccf5f90b0870 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:11.583515 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-aa73aa40-098b-47e6-837a-ccf5f90b0870 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:11.584354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-aa73aa40-098b-47e6-837a-ccf5f90b0870 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:11.717691 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-6f62f751-5c33-40bd-a5ab-5307a22aeb7b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:11.737092 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-6f62f751-5c33-40bd-a5ab-5307a22aeb7b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:11.740273 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-6f62f751-5c33-40bd-a5ab-5307a22aeb7b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:11.742452 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-6f62f751-5c33-40bd-a5ab-5307a22aeb7b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1406 microversion: 2.20 time: 0.614694 May 16 20:37:11.744694 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 42/84] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:11 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1406 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:37:11.999077 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-aa73aa40-098b-47e6-837a-ccf5f90b0870 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:12.007104 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-aa73aa40-098b-47e6-837a-ccf5f90b0870 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1315 microversion: 2.1 time: 0.439638 May 16 20:37:12.016789 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 43/85] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:11 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:12.552785 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2f6b4edf-1c61-4381-869f-74b8862512cb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:12.554043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-2f6b4edf-1c61-4381-869f-74b8862512cb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:12.573755 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2f6b4edf-1c61-4381-869f-74b8862512cb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:12.575753 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2f6b4edf-1c61-4381-869f-74b8862512cb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:12.581560 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2f6b4edf-1c61-4381-869f-74b8862512cb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:12.584324 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2f6b4edf-1c61-4381-869f-74b8862512cb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:12.763344 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-4af6fb5d-7565-46e4-afd1-dbafc51e4ca4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:12.763843 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-4af6fb5d-7565-46e4-afd1-dbafc51e4ca4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:12.782163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4af6fb5d-7565-46e4-afd1-dbafc51e4ca4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:12.787998 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4af6fb5d-7565-46e4-afd1-dbafc51e4ca4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:12.790172 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4af6fb5d-7565-46e4-afd1-dbafc51e4ca4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:12.792916 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4af6fb5d-7565-46e4-afd1-dbafc51e4ca4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:13.757047 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-2f6b4edf-1c61-4381-869f-74b8862512cb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:13.776176 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-2f6b4edf-1c61-4381-869f-74b8862512cb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1366 microversion: 2.1 time: 1.228329 May 16 20:37:13.779478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 43/86] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:12 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1366 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:13.843763 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-4af6fb5d-7565-46e4-afd1-dbafc51e4ca4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:13.871466 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-4af6fb5d-7565-46e4-afd1-dbafc51e4ca4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:13.873247 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-4af6fb5d-7565-46e4-afd1-dbafc51e4ca4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:13.882630 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-4af6fb5d-7565-46e4-afd1-dbafc51e4ca4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1406 microversion: 2.20 time: 1.124534 May 16 20:37:13.883697 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 44/87] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:12 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1406 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:37:13.891726 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-b295e79f-d94f-4e79-9997-e79bf9031c73 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:13.892678 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-b295e79f-d94f-4e79-9997-e79bf9031c73 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:13.900715 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b295e79f-d94f-4e79-9997-e79bf9031c73 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:13.901597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b295e79f-d94f-4e79-9997-e79bf9031c73 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:13.902819 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b295e79f-d94f-4e79-9997-e79bf9031c73 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:13.903448 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b295e79f-d94f-4e79-9997-e79bf9031c73 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:14.149605 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-49985ad3-ac06-49e8-842a-4471af79615f req-2727c044-e52f-465a-824f-ba818692d66b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df423e7b-a5e3-4c9a-adbc-b64a2afd9752", "tag": "666e8c7b-f3e1-4b80-bf22-b473c22db3cd"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:37:14.180075 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-49985ad3-ac06-49e8-842a-4471af79615f req-2727c044-e52f-465a-824f-ba818692d66b service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:14.180936 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-49985ad3-ac06-49e8-842a-4471af79615f req-2727c044-e52f-465a-824f-ba818692d66b service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:14.246755 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-49985ad3-ac06-49e8-842a-4471af79615f req-2727c044-e52f-465a-824f-ba818692d66b service nova] Creating event network-changed:666e8c7b-f3e1-4b80-bf22-b473c22db3cd for instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 on hv-cinder-77703 May 16 20:37:14.247607 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-49985ad3-ac06-49e8-842a-4471af79615f req-2727c044-e52f-465a-824f-ba818692d66b service nova] Acquired lock "compute-rpcapi-router" {{(pid=123563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 16 20:37:14.248832 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f9f7c957-b6da-45cf-b355-8dde8b437010 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:14.251629 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f9f7c957-b6da-45cf-b355-8dde8b437010 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:14.253702 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f9f7c957-b6da-45cf-b355-8dde8b437010 None None] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:14.254145 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f9f7c957-b6da-45cf-b355-8dde8b437010 None None] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:14.294941 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.compute.rpcapi [None req-f9f7c957-b6da-45cf-b355-8dde8b437010 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 16 20:37:14.296010 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f9f7c957-b6da-45cf-b355-8dde8b437010 None None] Releasing lock "compute-rpcapi-router" {{(pid=123563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 16 20:37:14.378293 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-f9f7c957-b6da-45cf-b355-8dde8b437010 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.596761 May 16 20:37:14.378944 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 44/88] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:37:14.473194 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-b295e79f-d94f-4e79-9997-e79bf9031c73 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:14.487385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-b295e79f-d94f-4e79-9997-e79bf9031c73 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1315 microversion: 2.1 time: 0.600262 May 16 20:37:14.490158 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 45/89] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:13 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:14.795794 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-4af8d916-5f0f-4ef3-aa94-66f1911d2654 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:14.797330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-4af8d916-5f0f-4ef3-aa94-66f1911d2654 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:14.818492 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4af8d916-5f0f-4ef3-aa94-66f1911d2654 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:14.819119 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4af8d916-5f0f-4ef3-aa94-66f1911d2654 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:14.829569 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4af8d916-5f0f-4ef3-aa94-66f1911d2654 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:14.830250 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4af8d916-5f0f-4ef3-aa94-66f1911d2654 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:14.902718 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-14494c17-cfb7-4f4e-b35d-6ce7eae82c14 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:14.904363 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-14494c17-cfb7-4f4e-b35d-6ce7eae82c14 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:14.911230 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-14494c17-cfb7-4f4e-b35d-6ce7eae82c14 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:14.911862 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-14494c17-cfb7-4f4e-b35d-6ce7eae82c14 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:14.913154 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-14494c17-cfb7-4f4e-b35d-6ce7eae82c14 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:14.914607 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-14494c17-cfb7-4f4e-b35d-6ce7eae82c14 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:15.417529 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-4af8d916-5f0f-4ef3-aa94-66f1911d2654 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:15.431904 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-4af8d916-5f0f-4ef3-aa94-66f1911d2654 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1366 microversion: 2.1 time: 0.640455 May 16 20:37:15.436685 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-14494c17-cfb7-4f4e-b35d-6ce7eae82c14 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:15.445812 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-14494c17-cfb7-4f4e-b35d-6ce7eae82c14 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:15.451877 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 45/90] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:14 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1366 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:15.459436 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-14494c17-cfb7-4f4e-b35d-6ce7eae82c14 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:15.473589 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-14494c17-cfb7-4f4e-b35d-6ce7eae82c14 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1406 microversion: 2.20 time: 0.575942 May 16 20:37:15.486662 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 46/91] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:14 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1406 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:37:15.510019 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-75f27359-2ef4-47a5-b6ce-bafdc203845f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:15.514481 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-75f27359-2ef4-47a5-b6ce-bafdc203845f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:15.535057 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-75f27359-2ef4-47a5-b6ce-bafdc203845f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:15.544915 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-75f27359-2ef4-47a5-b6ce-bafdc203845f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:15.546596 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-75f27359-2ef4-47a5-b6ce-bafdc203845f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:15.548597 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-75f27359-2ef4-47a5-b6ce-bafdc203845f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:16.185826 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-75f27359-2ef4-47a5-b6ce-bafdc203845f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:16.199597 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-75f27359-2ef4-47a5-b6ce-bafdc203845f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1315 microversion: 2.1 time: 0.694540 May 16 20:37:16.200259 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 46/92] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:15 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:16.464503 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-b8aded29-7e25-4b11-8c11-47d968663d09 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:16.465263 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-b8aded29-7e25-4b11-8c11-47d968663d09 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:16.474643 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b8aded29-7e25-4b11-8c11-47d968663d09 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:16.475097 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b8aded29-7e25-4b11-8c11-47d968663d09 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:16.475889 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b8aded29-7e25-4b11-8c11-47d968663d09 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:16.476369 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b8aded29-7e25-4b11-8c11-47d968663d09 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:16.505727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-a7db18bf-cef1-4584-888b-d9f65a6ac26e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:16.506778 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-a7db18bf-cef1-4584-888b-d9f65a6ac26e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:16.527103 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a7db18bf-cef1-4584-888b-d9f65a6ac26e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:16.527920 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a7db18bf-cef1-4584-888b-d9f65a6ac26e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:16.528977 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a7db18bf-cef1-4584-888b-d9f65a6ac26e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:16.529684 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a7db18bf-cef1-4584-888b-d9f65a6ac26e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:16.867624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-b8aded29-7e25-4b11-8c11-47d968663d09 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:16.868756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a7db18bf-cef1-4584-888b-d9f65a6ac26e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:16.876733 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-b8aded29-7e25-4b11-8c11-47d968663d09 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1366 microversion: 2.1 time: 0.416440 May 16 20:37:16.882760 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a7db18bf-cef1-4584-888b-d9f65a6ac26e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:16.883461 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 47/93] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:16 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1366 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:16.885053 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a7db18bf-cef1-4584-888b-d9f65a6ac26e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:16.886608 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-a7db18bf-cef1-4584-888b-d9f65a6ac26e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1406 microversion: 2.20 time: 0.384889 May 16 20:37:16.887196 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 47/94] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:16 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:37:17.217037 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-d284d3d1-9282-4f5f-ac09-a3b503cf9d63 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:17.218717 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-d284d3d1-9282-4f5f-ac09-a3b503cf9d63 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:17.226806 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d284d3d1-9282-4f5f-ac09-a3b503cf9d63 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:17.227651 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d284d3d1-9282-4f5f-ac09-a3b503cf9d63 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:17.229264 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d284d3d1-9282-4f5f-ac09-a3b503cf9d63 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:17.230034 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d284d3d1-9282-4f5f-ac09-a3b503cf9d63 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:17.398140 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-d284d3d1-9282-4f5f-ac09-a3b503cf9d63 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:17.406217 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-d284d3d1-9282-4f5f-ac09-a3b503cf9d63 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1315 microversion: 2.1 time: 0.192715 May 16 20:37:17.417590 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 48/95] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:17 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:17.903148 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-e473bd29-bd60-4d28-9a9f-e2768416cf52 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:17.903768 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-e473bd29-bd60-4d28-9a9f-e2768416cf52 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:17.920999 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-3b73517d-e640-49d0-99b5-d943b8753cf4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:17.920999 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-3b73517d-e640-49d0-99b5-d943b8753cf4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:17.941757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e473bd29-bd60-4d28-9a9f-e2768416cf52 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:17.943887 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3b73517d-e640-49d0-99b5-d943b8753cf4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:17.944336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3b73517d-e640-49d0-99b5-d943b8753cf4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:17.946438 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e473bd29-bd60-4d28-9a9f-e2768416cf52 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:17.947409 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e473bd29-bd60-4d28-9a9f-e2768416cf52 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:17.947906 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e473bd29-bd60-4d28-9a9f-e2768416cf52 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:17.955570 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3b73517d-e640-49d0-99b5-d943b8753cf4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:17.956305 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3b73517d-e640-49d0-99b5-d943b8753cf4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:18.349239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-e473bd29-bd60-4d28-9a9f-e2768416cf52 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:18.351873 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3b73517d-e640-49d0-99b5-d943b8753cf4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:18.359945 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3b73517d-e640-49d0-99b5-d943b8753cf4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:18.360387 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-e473bd29-bd60-4d28-9a9f-e2768416cf52 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1366 microversion: 2.1 time: 0.459609 May 16 20:37:18.362710 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3b73517d-e640-49d0-99b5-d943b8753cf4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:18.364055 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-3b73517d-e640-49d0-99b5-d943b8753cf4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1406 microversion: 2.20 time: 0.458460 May 16 20:37:18.365064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 49/96] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:17 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1406 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:37:18.368650 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 48/97] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:17 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1366 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:18.424708 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-7d2013f5-18b5-45a0-9495-b93b57aba153 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:18.425633 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-7d2013f5-18b5-45a0-9495-b93b57aba153 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:18.435190 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7d2013f5-18b5-45a0-9495-b93b57aba153 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:18.436810 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7d2013f5-18b5-45a0-9495-b93b57aba153 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:18.436810 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7d2013f5-18b5-45a0-9495-b93b57aba153 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:18.436810 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7d2013f5-18b5-45a0-9495-b93b57aba153 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:18.704911 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-7d2013f5-18b5-45a0-9495-b93b57aba153 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:18.712985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-7d2013f5-18b5-45a0-9495-b93b57aba153 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1315 microversion: 2.1 time: 0.293411 May 16 20:37:18.714212 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 50/98] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:18 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:19.380973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-babcfe39-bd69-4cab-a295-a2f2c5acaf4f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:19.381643 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-babcfe39-bd69-4cab-a295-a2f2c5acaf4f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:19.385169 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-62c68c8c-3105-44ec-ae0a-f8cd5de33945 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:19.386883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-62c68c8c-3105-44ec-ae0a-f8cd5de33945 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:19.391263 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-babcfe39-bd69-4cab-a295-a2f2c5acaf4f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:19.391728 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-babcfe39-bd69-4cab-a295-a2f2c5acaf4f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:19.392553 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-babcfe39-bd69-4cab-a295-a2f2c5acaf4f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:19.392987 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-babcfe39-bd69-4cab-a295-a2f2c5acaf4f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:19.415510 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-62c68c8c-3105-44ec-ae0a-f8cd5de33945 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:19.416016 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-62c68c8c-3105-44ec-ae0a-f8cd5de33945 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:19.416863 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-62c68c8c-3105-44ec-ae0a-f8cd5de33945 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:19.417303 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-62c68c8c-3105-44ec-ae0a-f8cd5de33945 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:19.612173 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-babcfe39-bd69-4cab-a295-a2f2c5acaf4f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:19.618206 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-babcfe39-bd69-4cab-a295-a2f2c5acaf4f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:19.619803 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-babcfe39-bd69-4cab-a295-a2f2c5acaf4f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:19.621052 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-babcfe39-bd69-4cab-a295-a2f2c5acaf4f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1406 microversion: 2.20 time: 0.244242 May 16 20:37:19.622102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 51/99] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:19 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:37:19.665824 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-62c68c8c-3105-44ec-ae0a-f8cd5de33945 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:19.674194 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-62c68c8c-3105-44ec-ae0a-f8cd5de33945 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1366 microversion: 2.1 time: 0.299717 May 16 20:37:19.674809 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 49/100] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:19 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:19.730452 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-9d1b5e86-3cd8-4e83-a3e8-73066c47e445 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:19.730902 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-9d1b5e86-3cd8-4e83-a3e8-73066c47e445 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:19.738067 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9d1b5e86-3cd8-4e83-a3e8-73066c47e445 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:19.738519 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9d1b5e86-3cd8-4e83-a3e8-73066c47e445 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:19.739299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9d1b5e86-3cd8-4e83-a3e8-73066c47e445 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:19.739731 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9d1b5e86-3cd8-4e83-a3e8-73066c47e445 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:19.903739 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-9d1b5e86-3cd8-4e83-a3e8-73066c47e445 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:19.911614 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-9d1b5e86-3cd8-4e83-a3e8-73066c47e445 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1315 microversion: 2.1 time: 0.185171 May 16 20:37:19.912181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 52/101] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:19 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:20.639709 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-d9cc2313-f91c-4df8-9151-4b356b7c7a39 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:20.640960 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-d9cc2313-f91c-4df8-9151-4b356b7c7a39 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:20.648290 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d9cc2313-f91c-4df8-9151-4b356b7c7a39 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:20.648933 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d9cc2313-f91c-4df8-9151-4b356b7c7a39 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:20.650327 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d9cc2313-f91c-4df8-9151-4b356b7c7a39 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:20.652811 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d9cc2313-f91c-4df8-9151-4b356b7c7a39 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:20.692481 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6846f736-7618-4221-83b9-aaf7ec195582 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:20.693622 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-6846f736-7618-4221-83b9-aaf7ec195582 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:20.701590 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6846f736-7618-4221-83b9-aaf7ec195582 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:20.702033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6846f736-7618-4221-83b9-aaf7ec195582 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:20.702797 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6846f736-7618-4221-83b9-aaf7ec195582 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:20.703225 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6846f736-7618-4221-83b9-aaf7ec195582 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:21.153763 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d9cc2313-f91c-4df8-9151-4b356b7c7a39 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:21.169529 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d9cc2313-f91c-4df8-9151-4b356b7c7a39 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:21.174805 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d9cc2313-f91c-4df8-9151-4b356b7c7a39 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:21.176681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6846f736-7618-4221-83b9-aaf7ec195582 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:21.179322 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-d9cc2313-f91c-4df8-9151-4b356b7c7a39 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1406 microversion: 2.20 time: 0.541761 May 16 20:37:21.190788 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-6846f736-7618-4221-83b9-aaf7ec195582 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1366 microversion: 2.1 time: 0.499453 May 16 20:37:21.190788 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 53/102] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:20 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1366 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:37:21.192005 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 50/103] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:20 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1406 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:37:21.205004 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-807b4bab-2daa-493e-b2f9-51d8577df362 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:21.206007 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-807b4bab-2daa-493e-b2f9-51d8577df362 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:21.230585 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-807b4bab-2daa-493e-b2f9-51d8577df362 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:21.231143 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-807b4bab-2daa-493e-b2f9-51d8577df362 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:21.233700 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-807b4bab-2daa-493e-b2f9-51d8577df362 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:21.235467 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-807b4bab-2daa-493e-b2f9-51d8577df362 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:21.386528 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-807b4bab-2daa-493e-b2f9-51d8577df362 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:21.398111 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-807b4bab-2daa-493e-b2f9-51d8577df362 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1315 microversion: 2.1 time: 0.209300 May 16 20:37:21.399120 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 54/104] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:21 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:22.198553 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0ad26620-2936-4f02-a271-7cdeeda205a3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:22.200042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0ad26620-2936-4f02-a271-7cdeeda205a3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:22.207089 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0ad26620-2936-4f02-a271-7cdeeda205a3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:22.207849 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0ad26620-2936-4f02-a271-7cdeeda205a3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:22.208798 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-f229dff2-58dd-4572-9b71-f6ddba78c15b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:22.209636 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0ad26620-2936-4f02-a271-7cdeeda205a3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:22.210089 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-f229dff2-58dd-4572-9b71-f6ddba78c15b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:22.210555 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0ad26620-2936-4f02-a271-7cdeeda205a3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:22.220234 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f229dff2-58dd-4572-9b71-f6ddba78c15b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:22.223907 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f229dff2-58dd-4572-9b71-f6ddba78c15b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:22.224818 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f229dff2-58dd-4572-9b71-f6ddba78c15b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:22.225264 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f229dff2-58dd-4572-9b71-f6ddba78c15b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:22.463455 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-0ad26620-2936-4f02-a271-7cdeeda205a3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:22.479812 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-0ad26620-2936-4f02-a271-7cdeeda205a3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:22.482093 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-0ad26620-2936-4f02-a271-7cdeeda205a3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:22.483814 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0ad26620-2936-4f02-a271-7cdeeda205a3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1406 microversion: 2.20 time: 0.289280 May 16 20:37:22.484964 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 51/105] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:22 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:37:22.493122 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-65261c74-82fe-456b-9507-6d893b50bdfc tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:22.494226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-65261c74-82fe-456b-9507-6d893b50bdfc tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:22.501319 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-65261c74-82fe-456b-9507-6d893b50bdfc tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:22.502101 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-65261c74-82fe-456b-9507-6d893b50bdfc tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:22.503095 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-65261c74-82fe-456b-9507-6d893b50bdfc tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:22.503967 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-65261c74-82fe-456b-9507-6d893b50bdfc tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:22.521588 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-f229dff2-58dd-4572-9b71-f6ddba78c15b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:22.532133 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-f229dff2-58dd-4572-9b71-f6ddba78c15b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1366 microversion: 2.1 time: 0.327952 May 16 20:37:22.533934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 55/106] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:22 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:37:22.718174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-65261c74-82fe-456b-9507-6d893b50bdfc tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:22.731586 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-65261c74-82fe-456b-9507-6d893b50bdfc tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1315 microversion: 2.1 time: 0.245289 May 16 20:37:22.732185 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 52/107] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:22 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:23.508859 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-22c128a5-f86a-4d5d-87b3-96cbad7b5005 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:23.510304 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-22c128a5-f86a-4d5d-87b3-96cbad7b5005 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:23.528405 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-22c128a5-f86a-4d5d-87b3-96cbad7b5005 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:23.529111 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-22c128a5-f86a-4d5d-87b3-96cbad7b5005 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:23.531256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-22c128a5-f86a-4d5d-87b3-96cbad7b5005 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:23.531823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-22c128a5-f86a-4d5d-87b3-96cbad7b5005 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:23.552136 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-1e83431b-4cf9-45ef-8e67-9ccd2fc2d83b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:23.553777 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-1e83431b-4cf9-45ef-8e67-9ccd2fc2d83b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:23.567523 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1e83431b-4cf9-45ef-8e67-9ccd2fc2d83b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:23.568853 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1e83431b-4cf9-45ef-8e67-9ccd2fc2d83b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:23.571460 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1e83431b-4cf9-45ef-8e67-9ccd2fc2d83b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:23.572262 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1e83431b-4cf9-45ef-8e67-9ccd2fc2d83b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:23.827385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-22c128a5-f86a-4d5d-87b3-96cbad7b5005 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:23.837673 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-22c128a5-f86a-4d5d-87b3-96cbad7b5005 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:23.840970 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-22c128a5-f86a-4d5d-87b3-96cbad7b5005 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:23.842611 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-22c128a5-f86a-4d5d-87b3-96cbad7b5005 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1406 microversion: 2.20 time: 0.341430 May 16 20:37:23.843363 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 56/108] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:23 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1406 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:37:23.848091 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-7d9c9649-487d-4a82-bb28-9bc9711244df tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:23.848938 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-7d9c9649-487d-4a82-bb28-9bc9711244df tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:23.855479 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7d9c9649-487d-4a82-bb28-9bc9711244df tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:23.855910 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7d9c9649-487d-4a82-bb28-9bc9711244df tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:23.856923 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7d9c9649-487d-4a82-bb28-9bc9711244df tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:23.857596 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7d9c9649-487d-4a82-bb28-9bc9711244df tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:23.920795 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-1e83431b-4cf9-45ef-8e67-9ccd2fc2d83b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:23.933615 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-1e83431b-4cf9-45ef-8e67-9ccd2fc2d83b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1366 microversion: 2.1 time: 0.386439 May 16 20:37:23.936486 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 53/109] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:23 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:24.029915 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-7d9c9649-487d-4a82-bb28-9bc9711244df tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:24.038100 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-7d9c9649-487d-4a82-bb28-9bc9711244df tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1315 microversion: 2.1 time: 0.193572 May 16 20:37:24.039008 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 57/110] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:23 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:24.861721 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-840584a4-09e0-494f-9bfe-b66c5962158c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:24.862335 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-840584a4-09e0-494f-9bfe-b66c5962158c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:24.871420 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-840584a4-09e0-494f-9bfe-b66c5962158c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:24.872094 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-840584a4-09e0-494f-9bfe-b66c5962158c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:24.873236 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-840584a4-09e0-494f-9bfe-b66c5962158c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:24.873677 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-840584a4-09e0-494f-9bfe-b66c5962158c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:24.952009 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-0aba9e99-c403-4604-81ef-bcb5e86e2c0e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:24.953296 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-0aba9e99-c403-4604-81ef-bcb5e86e2c0e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:24.960582 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0aba9e99-c403-4604-81ef-bcb5e86e2c0e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:24.961035 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0aba9e99-c403-4604-81ef-bcb5e86e2c0e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:24.961822 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0aba9e99-c403-4604-81ef-bcb5e86e2c0e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:24.962257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0aba9e99-c403-4604-81ef-bcb5e86e2c0e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:25.058689 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-840584a4-09e0-494f-9bfe-b66c5962158c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:25.066839 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-840584a4-09e0-494f-9bfe-b66c5962158c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:25.071715 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-840584a4-09e0-494f-9bfe-b66c5962158c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:25.075088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-840584a4-09e0-494f-9bfe-b66c5962158c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1406 microversion: 2.20 time: 0.217155 May 16 20:37:25.075914 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 54/111] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:24 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:37:25.086506 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-07608ad0-8093-4c37-bfb9-be3d67ac01d3 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:25.087199 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-07608ad0-8093-4c37-bfb9-be3d67ac01d3 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:25.104504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-07608ad0-8093-4c37-bfb9-be3d67ac01d3 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:25.104940 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-07608ad0-8093-4c37-bfb9-be3d67ac01d3 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:25.105709 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-07608ad0-8093-4c37-bfb9-be3d67ac01d3 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:25.106160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-07608ad0-8093-4c37-bfb9-be3d67ac01d3 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:25.195340 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-0aba9e99-c403-4604-81ef-bcb5e86e2c0e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:25.204671 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-0aba9e99-c403-4604-81ef-bcb5e86e2c0e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1366 microversion: 2.1 time: 0.257544 May 16 20:37:25.205587 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 58/112] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:24 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:25.315178 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-07608ad0-8093-4c37-bfb9-be3d67ac01d3 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:25.322681 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-07608ad0-8093-4c37-bfb9-be3d67ac01d3 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1315 microversion: 2.1 time: 0.245573 May 16 20:37:25.333262 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 55/113] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:25 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:26.095137 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-cac5482a-a3f1-4b08-8dee-1ddbeb6ec011 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:26.095955 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-cac5482a-a3f1-4b08-8dee-1ddbeb6ec011 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:26.102430 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cac5482a-a3f1-4b08-8dee-1ddbeb6ec011 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:26.103061 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cac5482a-a3f1-4b08-8dee-1ddbeb6ec011 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:26.103989 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cac5482a-a3f1-4b08-8dee-1ddbeb6ec011 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:26.104569 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cac5482a-a3f1-4b08-8dee-1ddbeb6ec011 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:26.223942 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-180bb32e-3742-4b44-bba8-1fc046cf23c2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:26.225983 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-180bb32e-3742-4b44-bba8-1fc046cf23c2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:26.237627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-180bb32e-3742-4b44-bba8-1fc046cf23c2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:26.238408 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-180bb32e-3742-4b44-bba8-1fc046cf23c2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:26.239358 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-180bb32e-3742-4b44-bba8-1fc046cf23c2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:26.244943 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-180bb32e-3742-4b44-bba8-1fc046cf23c2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:26.345650 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-cac5482a-a3f1-4b08-8dee-1ddbeb6ec011 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:26.355996 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-cac5482a-a3f1-4b08-8dee-1ddbeb6ec011 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:26.358107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-cac5482a-a3f1-4b08-8dee-1ddbeb6ec011 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:26.359628 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-cac5482a-a3f1-4b08-8dee-1ddbeb6ec011 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1406 microversion: 2.20 time: 0.269090 May 16 20:37:26.360393 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 59/114] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:26 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:37:26.365997 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-9b4c9ad5-e7a2-4799-91c3-36a405112962 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:26.367428 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-9b4c9ad5-e7a2-4799-91c3-36a405112962 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:26.374221 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9b4c9ad5-e7a2-4799-91c3-36a405112962 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:26.374774 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9b4c9ad5-e7a2-4799-91c3-36a405112962 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:26.375855 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9b4c9ad5-e7a2-4799-91c3-36a405112962 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:26.376388 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9b4c9ad5-e7a2-4799-91c3-36a405112962 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:26.504407 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-180bb32e-3742-4b44-bba8-1fc046cf23c2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:26.513300 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-180bb32e-3742-4b44-bba8-1fc046cf23c2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1366 microversion: 2.1 time: 0.294913 May 16 20:37:26.517260 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 56/115] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:26 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:26.567459 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-9b4c9ad5-e7a2-4799-91c3-36a405112962 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:26.575659 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-9b4c9ad5-e7a2-4799-91c3-36a405112962 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1315 microversion: 2.1 time: 0.213786 May 16 20:37:26.585759 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 60/116] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:26 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:27.379012 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-74ae9fa6-56c7-4a44-b469-4fb558eeb4a0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:27.380295 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-74ae9fa6-56c7-4a44-b469-4fb558eeb4a0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:27.390258 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-74ae9fa6-56c7-4a44-b469-4fb558eeb4a0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:27.392012 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-74ae9fa6-56c7-4a44-b469-4fb558eeb4a0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:27.392846 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-74ae9fa6-56c7-4a44-b469-4fb558eeb4a0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:27.393286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-74ae9fa6-56c7-4a44-b469-4fb558eeb4a0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:27.545428 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-48778300-d74e-4334-83dd-c45077fcd302 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:27.549703 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-48778300-d74e-4334-83dd-c45077fcd302 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:27.568904 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-48778300-d74e-4334-83dd-c45077fcd302 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:27.571153 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-48778300-d74e-4334-83dd-c45077fcd302 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:27.573100 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-48778300-d74e-4334-83dd-c45077fcd302 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:27.573967 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-48778300-d74e-4334-83dd-c45077fcd302 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:27.744736 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-74ae9fa6-56c7-4a44-b469-4fb558eeb4a0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:27.752295 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-74ae9fa6-56c7-4a44-b469-4fb558eeb4a0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:27.765339 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-74ae9fa6-56c7-4a44-b469-4fb558eeb4a0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:27.766526 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-74ae9fa6-56c7-4a44-b469-4fb558eeb4a0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1406 microversion: 2.20 time: 0.391471 May 16 20:37:27.777319 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 57/117] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:27 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1406 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:37:27.794143 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2a5b23b3-c746-46f6-a501-d92654e10489 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:27.794910 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-2a5b23b3-c746-46f6-a501-d92654e10489 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:27.816031 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2a5b23b3-c746-46f6-a501-d92654e10489 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:27.816595 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2a5b23b3-c746-46f6-a501-d92654e10489 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:27.817429 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2a5b23b3-c746-46f6-a501-d92654e10489 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:27.818901 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2a5b23b3-c746-46f6-a501-d92654e10489 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:27.853567 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-48778300-d74e-4334-83dd-c45077fcd302 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:27.867251 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-48778300-d74e-4334-83dd-c45077fcd302 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1366 microversion: 2.1 time: 0.335542 May 16 20:37:27.868747 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 61/118] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:27 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:28.055538 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-2a5b23b3-c746-46f6-a501-d92654e10489 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:28.065599 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-2a5b23b3-c746-46f6-a501-d92654e10489 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1315 microversion: 2.1 time: 0.285377 May 16 20:37:28.066804 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 58/119] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:27 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:28.784170 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-f721d230-6d4d-4405-b353-69f931900b77 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:28.784841 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-f721d230-6d4d-4405-b353-69f931900b77 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:28.799079 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f721d230-6d4d-4405-b353-69f931900b77 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:28.799884 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f721d230-6d4d-4405-b353-69f931900b77 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:28.800750 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f721d230-6d4d-4405-b353-69f931900b77 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:28.801188 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f721d230-6d4d-4405-b353-69f931900b77 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:28.885457 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-efc8f9ed-529b-4553-a251-0adf942310d9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:28.886915 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-efc8f9ed-529b-4553-a251-0adf942310d9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:28.894918 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-efc8f9ed-529b-4553-a251-0adf942310d9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:28.895428 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-efc8f9ed-529b-4553-a251-0adf942310d9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:28.896243 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-efc8f9ed-529b-4553-a251-0adf942310d9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:28.896631 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-efc8f9ed-529b-4553-a251-0adf942310d9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:29.094002 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-f721d230-6d4d-4405-b353-69f931900b77 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:29.105459 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-f721d230-6d4d-4405-b353-69f931900b77 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:29.107252 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-f721d230-6d4d-4405-b353-69f931900b77 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:29.114037 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-efc8f9ed-529b-4553-a251-0adf942310d9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:29.119574 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-f721d230-6d4d-4405-b353-69f931900b77 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1406 microversion: 2.20 time: 0.339227 May 16 20:37:29.126259 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-efc8f9ed-529b-4553-a251-0adf942310d9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1366 microversion: 2.1 time: 0.243724 May 16 20:37:29.127150 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 59/120] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:28 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:37:29.132999 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 62/121] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:28 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1406 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:37:29.137197 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-227bbeaa-345a-4e5a-b553-2d72c45e38b8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:29.137873 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-227bbeaa-345a-4e5a-b553-2d72c45e38b8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:29.146729 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-227bbeaa-345a-4e5a-b553-2d72c45e38b8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:29.147437 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-227bbeaa-345a-4e5a-b553-2d72c45e38b8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:29.148938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-227bbeaa-345a-4e5a-b553-2d72c45e38b8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:29.149638 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-227bbeaa-345a-4e5a-b553-2d72c45e38b8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:29.413140 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-227bbeaa-345a-4e5a-b553-2d72c45e38b8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:29.429207 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-227bbeaa-345a-4e5a-b553-2d72c45e38b8 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1315 microversion: 2.1 time: 0.298546 May 16 20:37:29.429810 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 60/122] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:29 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:29.456317 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-87741acf-98bb-477b-93ec-3ab0036ebe16 req-78602dce-10aa-4959-8724-df9006395729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "952d1913-9e82-4b2c-b4b5-3edf96b62106", "name": "network-vif-plugged", "status": "completed", "tag": "04948340-2c71-481a-9c29-71b06aca8082"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:37:29.471990 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-87741acf-98bb-477b-93ec-3ab0036ebe16 req-78602dce-10aa-4959-8724-df9006395729 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:29.472472 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-87741acf-98bb-477b-93ec-3ab0036ebe16 req-78602dce-10aa-4959-8724-df9006395729 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:29.498046 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-87741acf-98bb-477b-93ec-3ab0036ebe16 req-78602dce-10aa-4959-8724-df9006395729 service nova] Creating event network-vif-plugged:04948340-2c71-481a-9c29-71b06aca8082 for instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 on hv-cinder-77703 May 16 20:37:29.510202 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-87741acf-98bb-477b-93ec-3ab0036ebe16 req-78602dce-10aa-4959-8724-df9006395729 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153606 May 16 20:37:29.516183 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 63/123] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:37:30.141434 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-c5970359-b657-4159-ad2c-ab0d33ed89ec tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:30.143112 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-c5970359-b657-4159-ad2c-ab0d33ed89ec tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:30.146128 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-5cf225a6-1e3c-4933-8464-f1407977fbb4 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:30.146975 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-5cf225a6-1e3c-4933-8464-f1407977fbb4 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:30.151479 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c5970359-b657-4159-ad2c-ab0d33ed89ec tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:30.154050 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5cf225a6-1e3c-4933-8464-f1407977fbb4 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:30.154788 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5cf225a6-1e3c-4933-8464-f1407977fbb4 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:30.155685 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5cf225a6-1e3c-4933-8464-f1407977fbb4 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:30.156257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5cf225a6-1e3c-4933-8464-f1407977fbb4 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:30.158059 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c5970359-b657-4159-ad2c-ab0d33ed89ec tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:30.159050 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c5970359-b657-4159-ad2c-ab0d33ed89ec tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:30.160649 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c5970359-b657-4159-ad2c-ab0d33ed89ec tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:30.386163 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-c5970359-b657-4159-ad2c-ab0d33ed89ec tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:30.407808 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-c5970359-b657-4159-ad2c-ab0d33ed89ec tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:30.415641 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-c5970359-b657-4159-ad2c-ab0d33ed89ec tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:30.416891 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-c5970359-b657-4159-ad2c-ab0d33ed89ec tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1406 microversion: 2.20 time: 0.281130 May 16 20:37:30.437836 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 61/124] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:30 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1406 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:37:30.444878 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-5cf225a6-1e3c-4933-8464-f1407977fbb4 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:30.447532 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-deff4bed-c725-4db4-b492-ff74a15561c1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:30.448248 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-deff4bed-c725-4db4-b492-ff74a15561c1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:30.462666 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-5cf225a6-1e3c-4933-8464-f1407977fbb4 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1366 microversion: 2.1 time: 0.323024 May 16 20:37:30.463380 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-deff4bed-c725-4db4-b492-ff74a15561c1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:30.463473 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 64/125] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:30 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:37:30.463547 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-deff4bed-c725-4db4-b492-ff74a15561c1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:30.464312 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-deff4bed-c725-4db4-b492-ff74a15561c1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:30.464819 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-deff4bed-c725-4db4-b492-ff74a15561c1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:30.619578 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-deff4bed-c725-4db4-b492-ff74a15561c1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:30.627276 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-deff4bed-c725-4db4-b492-ff74a15561c1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1315 microversion: 2.1 time: 0.183772 May 16 20:37:30.627877 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 62/126] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:30 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:31.435571 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-02ff5cc7-d0a7-460e-b60f-a0e6603c2ea8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:31.436298 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-02ff5cc7-d0a7-460e-b60f-a0e6603c2ea8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:31.442464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-02ff5cc7-d0a7-460e-b60f-a0e6603c2ea8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:31.442916 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-02ff5cc7-d0a7-460e-b60f-a0e6603c2ea8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:31.443692 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-02ff5cc7-d0a7-460e-b60f-a0e6603c2ea8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:31.444143 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-02ff5cc7-d0a7-460e-b60f-a0e6603c2ea8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:31.481927 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-cb2a4753-4cba-495d-bea1-b71806696575 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:31.482552 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-cb2a4753-4cba-495d-bea1-b71806696575 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:31.490395 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cb2a4753-4cba-495d-bea1-b71806696575 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:31.490846 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cb2a4753-4cba-495d-bea1-b71806696575 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:31.491626 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cb2a4753-4cba-495d-bea1-b71806696575 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:31.492065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cb2a4753-4cba-495d-bea1-b71806696575 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:31.653787 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-02ff5cc7-d0a7-460e-b60f-a0e6603c2ea8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:31.670964 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-02ff5cc7-d0a7-460e-b60f-a0e6603c2ea8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:31.672523 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-02ff5cc7-d0a7-460e-b60f-a0e6603c2ea8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:31.679551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-02ff5cc7-d0a7-460e-b60f-a0e6603c2ea8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1406 microversion: 2.20 time: 0.247220 May 16 20:37:31.681547 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 65/127] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:31 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:37:31.688120 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-cb2a4753-4cba-495d-bea1-b71806696575 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:31.693017 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-72b904b7-5a4f-4c0a-b0d8-3123dcf80556 req-ce9a69d0-d71f-4e8e-b556-8b3e2572006e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df423e7b-a5e3-4c9a-adbc-b64a2afd9752", "name": "network-vif-plugged", "status": "completed", "tag": "666e8c7b-f3e1-4b80-bf22-b473c22db3cd"}, {"server_uuid": "6f8d450f-828f-4002-b649-ff13d14a047c", "name": "network-vif-plugged", "status": "completed", "tag": "6aa491fa-5223-4d44-b9ca-f8811045b0ad"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:37:31.696720 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-cb2a4753-4cba-495d-bea1-b71806696575 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1366 microversion: 2.1 time: 0.220255 May 16 20:37:31.698948 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 63/128] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:31 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:37:31.703372 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-72b904b7-5a4f-4c0a-b0d8-3123dcf80556 req-ce9a69d0-d71f-4e8e-b556-8b3e2572006e service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:31.704064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-72b904b7-5a4f-4c0a-b0d8-3123dcf80556 req-ce9a69d0-d71f-4e8e-b556-8b3e2572006e service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:31.715104 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-6c842278-02e7-467c-aefd-09491834a381 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:31.717837 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-6c842278-02e7-467c-aefd-09491834a381 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:31.718865 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-72b904b7-5a4f-4c0a-b0d8-3123dcf80556 req-ce9a69d0-d71f-4e8e-b556-8b3e2572006e service nova] Creating event network-vif-plugged:666e8c7b-f3e1-4b80-bf22-b473c22db3cd for instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 on hv-cinder-77703 May 16 20:37:31.719370 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-72b904b7-5a4f-4c0a-b0d8-3123dcf80556 req-ce9a69d0-d71f-4e8e-b556-8b3e2572006e service nova] Creating event network-vif-plugged:6aa491fa-5223-4d44-b9ca-f8811045b0ad for instance 6f8d450f-828f-4002-b649-ff13d14a047c on hv-cinder-77703 May 16 20:37:31.727099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-72b904b7-5a4f-4c0a-b0d8-3123dcf80556 req-ce9a69d0-d71f-4e8e-b556-8b3e2572006e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043091 May 16 20:37:31.734085 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 66/129] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:37:31.734814 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6c842278-02e7-467c-aefd-09491834a381 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:31.735653 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6c842278-02e7-467c-aefd-09491834a381 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:31.736739 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6c842278-02e7-467c-aefd-09491834a381 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:31.737332 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6c842278-02e7-467c-aefd-09491834a381 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:31.940940 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-6c842278-02e7-467c-aefd-09491834a381 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:31.949969 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-6c842278-02e7-467c-aefd-09491834a381 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1315 microversion: 2.1 time: 0.240471 May 16 20:37:31.960717 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 64/130] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:31 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:32.698696 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6f64e62d-5a7b-4c27-a066-f35494f84308 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:32.699393 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-6f64e62d-5a7b-4c27-a066-f35494f84308 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:32.706744 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6f64e62d-5a7b-4c27-a066-f35494f84308 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:32.707231 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6f64e62d-5a7b-4c27-a066-f35494f84308 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:32.708006 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6f64e62d-5a7b-4c27-a066-f35494f84308 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:32.708461 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6f64e62d-5a7b-4c27-a066-f35494f84308 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:32.716860 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-9f6af3ec-adca-4588-b054-282c20e71150 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:32.717648 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-9f6af3ec-adca-4588-b054-282c20e71150 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:32.728872 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9f6af3ec-adca-4588-b054-282c20e71150 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:32.728872 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9f6af3ec-adca-4588-b054-282c20e71150 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:32.730540 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9f6af3ec-adca-4588-b054-282c20e71150 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:32.732180 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9f6af3ec-adca-4588-b054-282c20e71150 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:33.088035 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6f64e62d-5a7b-4c27-a066-f35494f84308 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:33.098695 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6f64e62d-5a7b-4c27-a066-f35494f84308 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:33.100676 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6f64e62d-5a7b-4c27-a066-f35494f84308 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:33.102029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-6f64e62d-5a7b-4c27-a066-f35494f84308 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1406 microversion: 2.20 time: 0.407556 May 16 20:37:33.102822 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 67/131] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:32 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1406 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:37:33.107765 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6f2a7624-de20-4be3-b0d9-b909cf7f6c5f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:33.108470 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-6f2a7624-de20-4be3-b0d9-b909cf7f6c5f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:33.114532 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6f2a7624-de20-4be3-b0d9-b909cf7f6c5f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:33.115062 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6f2a7624-de20-4be3-b0d9-b909cf7f6c5f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:33.115897 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6f2a7624-de20-4be3-b0d9-b909cf7f6c5f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:33.116404 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6f2a7624-de20-4be3-b0d9-b909cf7f6c5f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:33.125221 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-9f6af3ec-adca-4588-b054-282c20e71150 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:33.135200 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-9f6af3ec-adca-4588-b054-282c20e71150 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1366 microversion: 2.1 time: 0.423084 May 16 20:37:33.135853 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 65/132] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:32 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1366 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:33.265488 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6f2a7624-de20-4be3-b0d9-b909cf7f6c5f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:33.275696 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-6f2a7624-de20-4be3-b0d9-b909cf7f6c5f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1502 microversion: 2.1 time: 0.171637 May 16 20:37:33.276376 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 68/133] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:33 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:34.122604 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-8aa22912-3f10-41b4-bbe2-362a33cfe098 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:34.124145 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-8aa22912-3f10-41b4-bbe2-362a33cfe098 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:34.131489 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8aa22912-3f10-41b4-bbe2-362a33cfe098 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:34.132129 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8aa22912-3f10-41b4-bbe2-362a33cfe098 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:34.133217 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8aa22912-3f10-41b4-bbe2-362a33cfe098 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:34.133964 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8aa22912-3f10-41b4-bbe2-362a33cfe098 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:34.151410 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-436c59bb-14a0-463a-9ec2-0b55eb8d278e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:34.152021 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-436c59bb-14a0-463a-9ec2-0b55eb8d278e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:34.160386 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-436c59bb-14a0-463a-9ec2-0b55eb8d278e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:34.161408 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-436c59bb-14a0-463a-9ec2-0b55eb8d278e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:34.162207 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-436c59bb-14a0-463a-9ec2-0b55eb8d278e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:34.162644 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-436c59bb-14a0-463a-9ec2-0b55eb8d278e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:34.318779 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-8aa22912-3f10-41b4-bbe2-362a33cfe098 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:34.328772 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-8aa22912-3f10-41b4-bbe2-362a33cfe098 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:34.331119 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-8aa22912-3f10-41b4-bbe2-362a33cfe098 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:34.332888 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-8aa22912-3f10-41b4-bbe2-362a33cfe098 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1598 microversion: 2.20 time: 0.214547 May 16 20:37:34.334076 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 66/134] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:37:34 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1598 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:37:34.346810 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-436c59bb-14a0-463a-9ec2-0b55eb8d278e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:34.354674 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-5944cc62-694d-4c49-9c01-07bca1a66581 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:34.355110 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-436c59bb-14a0-463a-9ec2-0b55eb8d278e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1557 microversion: 2.1 time: 0.207870 May 16 20:37:34.355243 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-5944cc62-694d-4c49-9c01-07bca1a66581 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:34.358021 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 69/135] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:34 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1557 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:37:34.371247 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5944cc62-694d-4c49-9c01-07bca1a66581 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:34.372619 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5944cc62-694d-4c49-9c01-07bca1a66581 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:34.373704 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5944cc62-694d-4c49-9c01-07bca1a66581 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:34.374193 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-cc0248f4-92a8-4e57-932e-b2318d9e12b0 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:34.374723 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5944cc62-694d-4c49-9c01-07bca1a66581 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:34.375107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-cc0248f4-92a8-4e57-932e-b2318d9e12b0 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:34.381989 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cc0248f4-92a8-4e57-932e-b2318d9e12b0 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:34.382714 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cc0248f4-92a8-4e57-932e-b2318d9e12b0 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:34.383691 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cc0248f4-92a8-4e57-932e-b2318d9e12b0 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:34.384289 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cc0248f4-92a8-4e57-932e-b2318d9e12b0 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:34.548570 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-5944cc62-694d-4c49-9c01-07bca1a66581 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.197722 May 16 20:37:34.549325 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 67/136] 10.222.0.49 () {60 vars in 1315 bytes} [Mon May 16 20:37:34 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c/os-interface => generated 284 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 20:37:34.575007 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-cc0248f4-92a8-4e57-932e-b2318d9e12b0 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.204281 May 16 20:37:34.575833 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 70/137] 10.222.0.49 () {58 vars in 1274 bytes} [Mon May 16 20:37:34 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752/os-interface => generated 285 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:37:34.781378 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-e80a5f6e-bb95-4522-803f-9483bfff18bb tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc216832-d3e6-4575-bbf6-ab60486d94e4"}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:37:34.782636 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-e80a5f6e-bb95-4522-803f-9483bfff18bb tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:34.793769 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e80a5f6e-bb95-4522-803f-9483bfff18bb tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:34.794239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e80a5f6e-bb95-4522-803f-9483bfff18bb tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:34.795045 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e80a5f6e-bb95-4522-803f-9483bfff18bb tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:34.795479 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e80a5f6e-bb95-4522-803f-9483bfff18bb tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:35.932892 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-e82af3e6-1aeb-4400-8ee5-07ce4aa2bb1a req-647e72fa-958d-4fec-938c-c49b4f997bff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f8d450f-828f-4002-b649-ff13d14a047c", "tag": "6aa491fa-5223-4d44-b9ca-f8811045b0ad"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:37:35.941739 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-e82af3e6-1aeb-4400-8ee5-07ce4aa2bb1a req-647e72fa-958d-4fec-938c-c49b4f997bff service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:35.942589 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-e82af3e6-1aeb-4400-8ee5-07ce4aa2bb1a req-647e72fa-958d-4fec-938c-c49b4f997bff service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:35.963114 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-e82af3e6-1aeb-4400-8ee5-07ce4aa2bb1a req-647e72fa-958d-4fec-938c-c49b4f997bff service nova] Creating event network-changed:6aa491fa-5223-4d44-b9ca-f8811045b0ad for instance 6f8d450f-828f-4002-b649-ff13d14a047c on hv-cinder-77703 May 16 20:37:35.968201 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-e82af3e6-1aeb-4400-8ee5-07ce4aa2bb1a req-647e72fa-958d-4fec-938c-c49b4f997bff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039347 May 16 20:37:35.972501 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 71/138] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:37:36.012567 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-3031dc1f-436b-4e2f-b254-9f1b3b5bf229 req-4f903e33-b3cf-4fa5-a2aa-22ba83a2a05f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df423e7b-a5e3-4c9a-adbc-b64a2afd9752", "tag": "666e8c7b-f3e1-4b80-bf22-b473c22db3cd"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:37:36.020856 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-3031dc1f-436b-4e2f-b254-9f1b3b5bf229 req-4f903e33-b3cf-4fa5-a2aa-22ba83a2a05f service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:36.021299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-3031dc1f-436b-4e2f-b254-9f1b3b5bf229 req-4f903e33-b3cf-4fa5-a2aa-22ba83a2a05f service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:36.032072 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-3031dc1f-436b-4e2f-b254-9f1b3b5bf229 req-4f903e33-b3cf-4fa5-a2aa-22ba83a2a05f service nova] Creating event network-changed:666e8c7b-f3e1-4b80-bf22-b473c22db3cd for instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 on hv-cinder-77703 May 16 20:37:36.037746 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-3031dc1f-436b-4e2f-b254-9f1b3b5bf229 req-4f903e33-b3cf-4fa5-a2aa-22ba83a2a05f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031269 May 16 20:37:36.038834 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 72/139] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:37:39.945840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-e80a5f6e-bb95-4522-803f-9483bfff18bb tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "POST /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.168764 May 16 20:37:39.953017 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 68/140] 10.222.0.49 () {60 vars in 1322 bytes} [Mon May 16 20:37:34 2022] POST /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106/os-volume_attachments => generated 194 bytes in 5177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:37:51.787634 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-596ba0ab-87a4-452a-af42-025aa044f21f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:51.788222 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-596ba0ab-87a4-452a-af42-025aa044f21f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:51.794409 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-596ba0ab-87a4-452a-af42-025aa044f21f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:51.794862 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-596ba0ab-87a4-452a-af42-025aa044f21f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:51.795638 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-596ba0ab-87a4-452a-af42-025aa044f21f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:51.796072 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-596ba0ab-87a4-452a-af42-025aa044f21f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:51.847887 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-596ba0ab-87a4-452a-af42-025aa044f21f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Going to try to terminate instance {{(pid=123564) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:37:51.963802 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-596ba0ab-87a4-452a-af42-025aa044f21f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "DELETE /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 204 len: 0 microversion: 2.1 time: 0.180047 May 16 20:37:51.964406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 73/141] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:37:51 2022] DELETE /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 20:37:51.975845 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-4ad824d2-726c-4822-b4ca-bbb1c596f46f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:51.975845 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-4ad824d2-726c-4822-b4ca-bbb1c596f46f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:51.983468 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4ad824d2-726c-4822-b4ca-bbb1c596f46f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:51.984110 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4ad824d2-726c-4822-b4ca-bbb1c596f46f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:51.985025 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4ad824d2-726c-4822-b4ca-bbb1c596f46f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:51.985567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4ad824d2-726c-4822-b4ca-bbb1c596f46f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:52.127803 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-4ad824d2-726c-4822-b4ca-bbb1c596f46f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:52.136865 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-4ad824d2-726c-4822-b4ca-bbb1c596f46f tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1554 microversion: 2.1 time: 0.167199 May 16 20:37:52.137963 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 69/142] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:51 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:53.155229 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-0bee52af-89c2-4097-bf70-f22feb06aa5d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:53.155931 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-0bee52af-89c2-4097-bf70-f22feb06aa5d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:53.162429 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0bee52af-89c2-4097-bf70-f22feb06aa5d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:53.162956 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0bee52af-89c2-4097-bf70-f22feb06aa5d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:53.163808 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0bee52af-89c2-4097-bf70-f22feb06aa5d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:53.164236 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0bee52af-89c2-4097-bf70-f22feb06aa5d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:53.306143 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-0bee52af-89c2-4097-bf70-f22feb06aa5d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:53.314138 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-0bee52af-89c2-4097-bf70-f22feb06aa5d tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1554 microversion: 2.1 time: 0.163302 May 16 20:37:53.314699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 74/143] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:53 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:54.331124 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-834b8ea3-3419-4d08-9e4b-550c12665fca tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:54.331742 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-834b8ea3-3419-4d08-9e4b-550c12665fca tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:54.338257 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-834b8ea3-3419-4d08-9e4b-550c12665fca tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:54.338708 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-834b8ea3-3419-4d08-9e4b-550c12665fca tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:54.339478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-834b8ea3-3419-4d08-9e4b-550c12665fca tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:54.339907 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-834b8ea3-3419-4d08-9e4b-550c12665fca tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:54.465354 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-834b8ea3-3419-4d08-9e4b-550c12665fca tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:54.473338 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-834b8ea3-3419-4d08-9e4b-550c12665fca tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1554 microversion: 2.1 time: 0.146230 May 16 20:37:54.474064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 70/144] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:54 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1554 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:55.491376 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-f354bdc8-2ce0-4499-bc2f-087ef28d522e tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:55.491876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-f354bdc8-2ce0-4499-bc2f-087ef28d522e tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:55.498617 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f354bdc8-2ce0-4499-bc2f-087ef28d522e tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:55.499312 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f354bdc8-2ce0-4499-bc2f-087ef28d522e tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:55.500292 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f354bdc8-2ce0-4499-bc2f-087ef28d522e tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:55.500923 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f354bdc8-2ce0-4499-bc2f-087ef28d522e tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:55.646368 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-f354bdc8-2ce0-4499-bc2f-087ef28d522e tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:55.654248 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-f354bdc8-2ce0-4499-bc2f-087ef28d522e tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1554 microversion: 2.1 time: 0.167565 May 16 20:37:55.664137 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 75/145] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:55 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:56.674628 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-e5e84fca-bf86-4dfd-b764-666a4230f760 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:56.675230 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-e5e84fca-bf86-4dfd-b764-666a4230f760 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:56.685634 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e5e84fca-bf86-4dfd-b764-666a4230f760 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:56.686222 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e5e84fca-bf86-4dfd-b764-666a4230f760 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:56.687312 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e5e84fca-bf86-4dfd-b764-666a4230f760 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:56.687882 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e5e84fca-bf86-4dfd-b764-666a4230f760 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:56.832117 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-e5e84fca-bf86-4dfd-b764-666a4230f760 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:56.840357 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-e5e84fca-bf86-4dfd-b764-666a4230f760 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1554 microversion: 2.1 time: 0.171602 May 16 20:37:56.840954 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 71/146] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:56 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:57.859202 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-51f0b9c7-243b-4038-9be4-eee324e04890 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:57.859808 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-51f0b9c7-243b-4038-9be4-eee324e04890 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:57.866593 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-51f0b9c7-243b-4038-9be4-eee324e04890 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:57.867051 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-51f0b9c7-243b-4038-9be4-eee324e04890 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:57.867832 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-51f0b9c7-243b-4038-9be4-eee324e04890 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:57.868265 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-51f0b9c7-243b-4038-9be4-eee324e04890 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:58.031799 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-51f0b9c7-243b-4038-9be4-eee324e04890 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:58.040815 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-51f0b9c7-243b-4038-9be4-eee324e04890 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1554 microversion: 2.1 time: 0.186847 May 16 20:37:58.041399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 76/147] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:57 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:37:58.690750 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-7673aba1-60fe-4b99-bd14-9371a99ec409 req-6d15df50-3fe5-4294-afe3-c2028a9c235b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "952d1913-9e82-4b2c-b4b5-3edf96b62106", "name": "network-vif-deleted", "tag": "04948340-2c71-481a-9c29-71b06aca8082"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:37:58.704406 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-7673aba1-60fe-4b99-bd14-9371a99ec409 req-6d15df50-3fe5-4294-afe3-c2028a9c235b service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:58.705712 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-7673aba1-60fe-4b99-bd14-9371a99ec409 req-6d15df50-3fe5-4294-afe3-c2028a9c235b service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:58.724064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-7673aba1-60fe-4b99-bd14-9371a99ec409 req-6d15df50-3fe5-4294-afe3-c2028a9c235b service nova] Creating event network-vif-deleted:04948340-2c71-481a-9c29-71b06aca8082 for instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 on hv-cinder-77703 May 16 20:37:58.731302 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-7673aba1-60fe-4b99-bd14-9371a99ec409 req-6d15df50-3fe5-4294-afe3-c2028a9c235b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045455 May 16 20:37:58.735638 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 72/148] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:37:59.059357 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-942b9f85-ce16-4524-86e2-b25d76d05bb2 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:37:59.060075 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-942b9f85-ce16-4524-86e2-b25d76d05bb2 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:37:59.066042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-942b9f85-ce16-4524-86e2-b25d76d05bb2 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:59.066510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-942b9f85-ce16-4524-86e2-b25d76d05bb2 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:59.067351 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-942b9f85-ce16-4524-86e2-b25d76d05bb2 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:37:59.067775 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-942b9f85-ce16-4524-86e2-b25d76d05bb2 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:37:59.225735 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-942b9f85-ce16-4524-86e2-b25d76d05bb2 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fd6d77aa949d5b5919432cb722b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c116936d14470bb13850d6b8c83f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:37:59.234817 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-942b9f85-ce16-4524-86e2-b25d76d05bb2 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 200 len: 1346 microversion: 2.1 time: 0.179121 May 16 20:37:59.244996 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 77/149] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:37:59 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 1346 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:00.255008 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-46219c94-aa07-4cb8-83d8-11149c717cf1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:00.257740 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-46219c94-aa07-4cb8-83d8-11149c717cf1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:00.267380 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-46219c94-aa07-4cb8-83d8-11149c717cf1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:00.268050 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-46219c94-aa07-4cb8-83d8-11149c717cf1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:00.269708 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-46219c94-aa07-4cb8-83d8-11149c717cf1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:00.270423 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-46219c94-aa07-4cb8-83d8-11149c717cf1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:00.290835 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-46219c94-aa07-4cb8-83d8-11149c717cf1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] HTTP exception thrown: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. May 16 20:38:00.297160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-46219c94-aa07-4cb8-83d8-11149c717cf1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Request method failure captured: May 16 20:38:00.297160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 HTTP/1.1 May 16 20:38:00.297160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:38:00.297160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:38:00.297160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:38:00.297160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:38:00.297160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:38:00.297160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:38:00.297160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:38:00.297160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:38:00.297160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrXgIhABmo_Ml4gMisdE7LpoM4WSq9ik6SnvGrN9jpOHSrMXrXpesx902mKQGVZVUVpyA4Ma3B7BigjUS4jp5E7qqWRmKH6Y1W-pzhHU3y0dPMRW1kvkEx0qCACGu_HKhzJ7ZN_QcktaJ-IPYrsa5QzqBuGnIpTl_A0FLJcs4mayu3c May 16 20:38:00.297160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:38:00.297160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:38:00.297160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:38:00.297160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:38:00.297160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:38:00.297160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:38:00.297160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 17c116936d14470bb13850d6b8c83f8e May 16 20:38:00.297160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-DeleteServersTestJSON-254920133 May 16 20:38:00.297160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:38:00.297160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:38:00.298476 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_17c116936d14470bb13850d6b8c83f8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17c116936d14470bb13850d6b8c83f8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/17c116936d14470bb13850d6b8c83f8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17c116936d14470bb13850d6b8c83f8e"}]}] May 16 20:38:00.298476 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-DeleteServersTestJSON-254920133 May 16 20:38:00.298476 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 17c116936d14470bb13850d6b8c83f8e May 16 20:38:00.298476 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-DeleteServersTestJSON-254920133 May 16 20:38:00.298476 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-DeleteServersTestJSON-254920133-project May 16 20:38:00.298476 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:38:00.298476 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:38:00.298476 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: 0f2fd6d77aa949d5b5919432cb722b37 May 16 20:38:00.298476 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-DeleteServersTestJSON-254920133-project May 16 20:38:00.298476 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: > May 16 20:38:00.298476 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. May 16 20:38:00.298476 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': '952d1913-9e82-4b2c-b4b5-3edf96b62106'} May 16 20:38:00.299182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:38:00.299182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:38:00.299182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:38:00.299182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:38:00.299182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:38:00.299182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:38:00.299182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:38:00.299182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:38:00.299182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:38:00.299182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:38:00.299182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. May 16 20:38:00.299182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:38:00.299182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:38:00.299182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:38:00.299182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:38:00.299182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:38:00.299182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:38:00.299182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:38:00.299182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:38:00.299182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:38:00.300417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:38:00.300417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:38:00.300417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:38:00.300417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:38:00.300417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:38:00.300417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:38:00.300417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:38:00.300417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. May 16 20:38:00.300417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:38:00.300417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:38:00.300417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:38:00.300417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:38:00.300417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:38:00.300417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:38:00.300417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:38:00.300417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:38:00.300417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. May 16 20:38:00.300417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:38:00.304310 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-46219c94-aa07-4cb8-83d8-11149c717cf1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Returning 404 to user: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:38:00.305903 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-46219c94-aa07-4cb8-83d8-11149c717cf1 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 404 len: 111 microversion: 2.1 time: 0.056947 May 16 20:38:00.307146 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 73/150] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:00 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:38:00.442421 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-c5bed0c3-4c12-4a31-9466-a82667ae4846 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:00.443378 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-c5bed0c3-4c12-4a31-9466-a82667ae4846 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:00.449607 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c5bed0c3-4c12-4a31-9466-a82667ae4846 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:00.450049 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c5bed0c3-4c12-4a31-9466-a82667ae4846 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:00.450828 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c5bed0c3-4c12-4a31-9466-a82667ae4846 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:00.451255 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c5bed0c3-4c12-4a31-9466-a82667ae4846 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:00.463824 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-c5bed0c3-4c12-4a31-9466-a82667ae4846 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] HTTP exception thrown: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. May 16 20:38:00.468699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-c5bed0c3-4c12-4a31-9466-a82667ae4846 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Request method failure captured: May 16 20:38:00.468699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106/os-volume_attachments HTTP/1.1 May 16 20:38:00.468699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:38:00.468699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:38:00.468699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:38:00.468699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:38:00.468699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:38:00.468699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:38:00.468699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:38:00.468699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:38:00.468699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrXgIhABmo_Ml4gMisdE7LpoM4WSq9ik6SnvGrN9jpOHSrMXrXpesx902mKQGVZVUVpyA4Ma3B7BigjUS4jp5E7qqWRmKH6Y1W-pzhHU3y0dPMRW1kvkEx0qCACGu_HKhzJ7ZN_QcktaJ-IPYrsa5QzqBuGnIpTl_A0FLJcs4mayu3c May 16 20:38:00.468699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:38:00.468699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:38:00.468699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:38:00.468699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:38:00.468699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:38:00.468699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:38:00.468699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 17c116936d14470bb13850d6b8c83f8e May 16 20:38:00.468699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-DeleteServersTestJSON-254920133 May 16 20:38:00.468699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:38:00.468699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:38:00.469982 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_17c116936d14470bb13850d6b8c83f8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17c116936d14470bb13850d6b8c83f8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/17c116936d14470bb13850d6b8c83f8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17c116936d14470bb13850d6b8c83f8e"}]}] May 16 20:38:00.469982 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-DeleteServersTestJSON-254920133 May 16 20:38:00.469982 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 17c116936d14470bb13850d6b8c83f8e May 16 20:38:00.469982 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-DeleteServersTestJSON-254920133 May 16 20:38:00.469982 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-DeleteServersTestJSON-254920133-project May 16 20:38:00.469982 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:38:00.469982 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:38:00.469982 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: 0f2fd6d77aa949d5b5919432cb722b37 May 16 20:38:00.469982 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-DeleteServersTestJSON-254920133-project May 16 20:38:00.469982 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:38:00.469982 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. May 16 20:38:00.469982 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'server_id': '952d1913-9e82-4b2c-b4b5-3edf96b62106'} May 16 20:38:00.470860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:38:00.470860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:38:00.470860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:38:00.470860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:38:00.470860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:38:00.470860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:38:00.470860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:38:00.470860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:38:00.470860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:38:00.470860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:38:00.470860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. May 16 20:38:00.470860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:38:00.470860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:38:00.470860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:38:00.470860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:38:00.470860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:38:00.470860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:38:00.470860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:38:00.470860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:38:00.470860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:38:00.472043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:38:00.472043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 16 20:38:00.472043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 20:38:00.472043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 16 20:38:00.472043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 20:38:00.472043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 16 20:38:00.472043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 16 20:38:00.472043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:38:00.472043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:38:00.472043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. May 16 20:38:00.472043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:38:00.472043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:38:00.472043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:38:00.472043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:38:00.472043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:38:00.472043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:38:00.472043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:38:00.472043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:38:00.472043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. May 16 20:38:00.472043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:38:00.473833 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-c5bed0c3-4c12-4a31-9466-a82667ae4846 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Returning 404 to user: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:38:00.473833 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-c5bed0c3-4c12-4a31-9466-a82667ae4846 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031709 May 16 20:38:00.473833 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 78/151] 10.222.0.49 () {58 vars in 1301 bytes} [Mon May 16 20:38:00 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 20:38:03.829653 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0881e4e5-71f2-4b3c-ac36-47dae631cc65 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:03.830275 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0881e4e5-71f2-4b3c-ac36-47dae631cc65 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:03.838454 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0881e4e5-71f2-4b3c-ac36-47dae631cc65 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:03.841201 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0881e4e5-71f2-4b3c-ac36-47dae631cc65 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:03.842079 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0881e4e5-71f2-4b3c-ac36-47dae631cc65 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:03.842541 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0881e4e5-71f2-4b3c-ac36-47dae631cc65 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:03.881131 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-0881e4e5-71f2-4b3c-ac36-47dae631cc65 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] HTTP exception thrown: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. May 16 20:38:03.882799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0881e4e5-71f2-4b3c-ac36-47dae631cc65 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Request method failure captured: May 16 20:38:03.882799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: DELETE /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 HTTP/1.1 May 16 20:38:03.882799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:38:03.882799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:38:03.882799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:38:03.882799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:38:03.882799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:38:03.882799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:38:03.882799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:38:03.882799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:38:03.882799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrXgIhABmo_Ml4gMisdE7LpoM4WSq9ik6SnvGrN9jpOHSrMXrXpesx902mKQGVZVUVpyA4Ma3B7BigjUS4jp5E7qqWRmKH6Y1W-pzhHU3y0dPMRW1kvkEx0qCACGu_HKhzJ7ZN_QcktaJ-IPYrsa5QzqBuGnIpTl_A0FLJcs4mayu3c May 16 20:38:03.882799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:38:03.882799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:38:03.882799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:38:03.882799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:38:03.882799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:38:03.882799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:38:03.882799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 17c116936d14470bb13850d6b8c83f8e May 16 20:38:03.882799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-DeleteServersTestJSON-254920133 May 16 20:38:03.882799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:38:03.882799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:38:03.884563 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_17c116936d14470bb13850d6b8c83f8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17c116936d14470bb13850d6b8c83f8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/17c116936d14470bb13850d6b8c83f8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17c116936d14470bb13850d6b8c83f8e"}]}] May 16 20:38:03.884563 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-DeleteServersTestJSON-254920133 May 16 20:38:03.884563 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 17c116936d14470bb13850d6b8c83f8e May 16 20:38:03.884563 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-DeleteServersTestJSON-254920133 May 16 20:38:03.884563 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-DeleteServersTestJSON-254920133-project May 16 20:38:03.884563 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:38:03.884563 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:38:03.884563 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: 0f2fd6d77aa949d5b5919432cb722b37 May 16 20:38:03.884563 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-DeleteServersTestJSON-254920133-project May 16 20:38:03.884563 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: > May 16 20:38:03.884563 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. May 16 20:38:03.884563 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': '952d1913-9e82-4b2c-b4b5-3edf96b62106'} May 16 20:38:03.885286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:38:03.885286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:38:03.885286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:38:03.885286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:38:03.885286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:38:03.885286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:38:03.885286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:38:03.885286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:38:03.885286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:38:03.885286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:38:03.885286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. May 16 20:38:03.885286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:38:03.885286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:38:03.885286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:38:03.885286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:38:03.885286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:38:03.885286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:38:03.885286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:38:03.885286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:38:03.885286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:38:03.887219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:38:03.887219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 20:38:03.887219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 20:38:03.887219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 20:38:03.887219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 20:38:03.887219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:38:03.887219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:38:03.887219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:38:03.887219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:38:03.887219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. May 16 20:38:03.887219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:38:03.887219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:38:03.887219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:38:03.887219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:38:03.887219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:38:03.887219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:38:03.887219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:38:03.887219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:38:03.887219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. May 16 20:38:03.887219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:38:03.889513 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0881e4e5-71f2-4b3c-ac36-47dae631cc65 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Returning 404 to user: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:38:03.889513 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0881e4e5-71f2-4b3c-ac36-47dae631cc65 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "DELETE /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 404 len: 111 microversion: 2.1 time: 0.059844 May 16 20:38:03.889513 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 74/152] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:38:03 2022] DELETE /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:38:03.896787 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e4975835-eb70-4c7b-8504-a6e9454200e6 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:03.897839 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-e4975835-eb70-4c7b-8504-a6e9454200e6 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] [instance: 952d1913-9e82-4b2c-b4b5-3edf96b62106] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:03.907774 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e4975835-eb70-4c7b-8504-a6e9454200e6 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:03.908281 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e4975835-eb70-4c7b-8504-a6e9454200e6 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:03.910233 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e4975835-eb70-4c7b-8504-a6e9454200e6 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:03.911297 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e4975835-eb70-4c7b-8504-a6e9454200e6 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:03.931983 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-e4975835-eb70-4c7b-8504-a6e9454200e6 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] HTTP exception thrown: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. May 16 20:38:03.934102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e4975835-eb70-4c7b-8504-a6e9454200e6 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Request method failure captured: May 16 20:38:03.934102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 HTTP/1.1 May 16 20:38:03.934102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:38:03.934102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:38:03.934102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:38:03.934102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:38:03.934102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:38:03.934102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:38:03.934102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:38:03.934102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:38:03.934102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrXgIhABmo_Ml4gMisdE7LpoM4WSq9ik6SnvGrN9jpOHSrMXrXpesx902mKQGVZVUVpyA4Ma3B7BigjUS4jp5E7qqWRmKH6Y1W-pzhHU3y0dPMRW1kvkEx0qCACGu_HKhzJ7ZN_QcktaJ-IPYrsa5QzqBuGnIpTl_A0FLJcs4mayu3c May 16 20:38:03.934102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:38:03.934102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:38:03.934102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:38:03.934102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:38:03.934102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:38:03.934102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:38:03.934102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 17c116936d14470bb13850d6b8c83f8e May 16 20:38:03.934102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-DeleteServersTestJSON-254920133 May 16 20:38:03.934102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:38:03.934102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:38:03.935673 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_17c116936d14470bb13850d6b8c83f8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17c116936d14470bb13850d6b8c83f8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/17c116936d14470bb13850d6b8c83f8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17c116936d14470bb13850d6b8c83f8e"}]}] May 16 20:38:03.935673 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-DeleteServersTestJSON-254920133 May 16 20:38:03.935673 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 17c116936d14470bb13850d6b8c83f8e May 16 20:38:03.935673 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-DeleteServersTestJSON-254920133 May 16 20:38:03.935673 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-DeleteServersTestJSON-254920133-project May 16 20:38:03.935673 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:38:03.935673 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:38:03.935673 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: 0f2fd6d77aa949d5b5919432cb722b37 May 16 20:38:03.935673 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-DeleteServersTestJSON-254920133-project May 16 20:38:03.935673 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:38:03.935673 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. May 16 20:38:03.935673 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': '952d1913-9e82-4b2c-b4b5-3edf96b62106'} May 16 20:38:03.936584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:38:03.936584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:38:03.936584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:38:03.936584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:38:03.936584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:38:03.936584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:38:03.936584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:38:03.936584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:38:03.936584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:38:03.936584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:38:03.936584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. May 16 20:38:03.936584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:38:03.936584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:38:03.936584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:38:03.936584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:38:03.936584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:38:03.936584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:38:03.936584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:38:03.936584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:38:03.936584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:38:03.938042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:38:03.938042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:38:03.938042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:38:03.938042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:38:03.938042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:38:03.938042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:38:03.938042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:38:03.938042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. May 16 20:38:03.938042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:38:03.938042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:38:03.938042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:38:03.938042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:38:03.938042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:38:03.938042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:38:03.938042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:38:03.938042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:38:03.938042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. May 16 20:38:03.938042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:38:03.939901 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e4975835-eb70-4c7b-8504-a6e9454200e6 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] Returning 404 to user: Instance 952d1913-9e82-4b2c-b4b5-3edf96b62106 could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:38:03.939901 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-e4975835-eb70-4c7b-8504-a6e9454200e6 tempest-DeleteServersTestJSON-254920133 tempest-DeleteServersTestJSON-254920133-project] 10.222.0.49 "GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106" status: 404 len: 111 microversion: 2.1 time: 0.044744 May 16 20:38:03.940189 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 79/153] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:03 2022] GET /compute/v2.1/servers/952d1913-9e82-4b2c-b4b5-3edf96b62106 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:38:11.472429 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0d7c5958-0bc6-4793-b076-9e7f030f2dd1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-118397092", "imageRef": "f9826e12-1d0c-4a5a-9616-338520403016", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:38:11.522183 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.network.neutron [None req-0d7c5958-0bc6-4793-b076-9e7f030f2dd1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] validate_networks() for [('e9d185e7-5065-44be-a31d-7429d98e5dea', None, None, None, None, None)] {{(pid=123563) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:38:11.899344 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-0d7c5958-0bc6-4793-b076-9e7f030f2dd1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Flavor limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:38:11.901614 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-0d7c5958-0bc6-4793-b076-9e7f030f2dd1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Image limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:38:11.902439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-0d7c5958-0bc6-4793-b076-9e7f030f2dd1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Flavor pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:38:11.903067 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-0d7c5958-0bc6-4793-b076-9e7f030f2dd1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Image pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:38:11.903691 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-0d7c5958-0bc6-4793-b076-9e7f030f2dd1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:38:11.915848 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0d7c5958-0bc6-4793-b076-9e7f030f2dd1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:11.916553 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0d7c5958-0bc6-4793-b076-9e7f030f2dd1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:11.917709 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0d7c5958-0bc6-4793-b076-9e7f030f2dd1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:11.918308 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0d7c5958-0bc6-4793-b076-9e7f030f2dd1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:11.939702 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-0d7c5958-0bc6-4793-b076-9e7f030f2dd1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Getting quotas for project 69e39fae43c341798f00e3b48f20d003. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:38:11.944959 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-0d7c5958-0bc6-4793-b076-9e7f030f2dd1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Getting quotas for user 20c57f1318cd4c73b2248b2d02896176 and project 69e39fae43c341798f00e3b48f20d003. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:38:11.958477 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0d7c5958-0bc6-4793-b076-9e7f030f2dd1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Going to run 1 instances... {{(pid=123563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:38:11.960931 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0d7c5958-0bc6-4793-b076-9e7f030f2dd1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9826e12-1d0c-4a5a-9616-338520403016',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:38:12.046473 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0d7c5958-0bc6-4793-b076-9e7f030f2dd1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.722683 May 16 20:38:12.052264 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 75/154] 10.222.0.49 () {60 vars in 1146 bytes} [Mon May 16 20:38:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 20:38:12.058010 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-541c3e7f-a8a6-47a8-b1a6-681d245b47b8 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:12.058749 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-541c3e7f-a8a6-47a8-b1a6-681d245b47b8 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:12.126404 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-541c3e7f-a8a6-47a8-b1a6-681d245b47b8 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:12.133125 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-541c3e7f-a8a6-47a8-b1a6-681d245b47b8 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1221 microversion: 2.1 time: 0.078900 May 16 20:38:12.133696 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 80/155] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:12 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1221 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:12.261333 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-a3d76460-3a6a-4536-b370-d8a7b5ba0408 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1366010158", "imageRef": "f9826e12-1d0c-4a5a-9616-338520403016", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:38:12.321992 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.network.neutron [None req-a3d76460-3a6a-4536-b370-d8a7b5ba0408 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] validate_networks() for [('e9d185e7-5065-44be-a31d-7429d98e5dea', None, None, None, None, None)] {{(pid=123563) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:38:12.858418 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-a3d76460-3a6a-4536-b370-d8a7b5ba0408 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Flavor limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:38:12.859116 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-a3d76460-3a6a-4536-b370-d8a7b5ba0408 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Image limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:38:12.859284 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-a3d76460-3a6a-4536-b370-d8a7b5ba0408 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Flavor pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:38:12.859902 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-a3d76460-3a6a-4536-b370-d8a7b5ba0408 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Image pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:38:12.860312 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-a3d76460-3a6a-4536-b370-d8a7b5ba0408 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:38:12.869867 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a3d76460-3a6a-4536-b370-d8a7b5ba0408 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:12.870641 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a3d76460-3a6a-4536-b370-d8a7b5ba0408 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:12.871639 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a3d76460-3a6a-4536-b370-d8a7b5ba0408 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:12.872240 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a3d76460-3a6a-4536-b370-d8a7b5ba0408 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:12.890601 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-a3d76460-3a6a-4536-b370-d8a7b5ba0408 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Getting quotas for project 69e39fae43c341798f00e3b48f20d003. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:38:12.894648 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-a3d76460-3a6a-4536-b370-d8a7b5ba0408 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Getting quotas for user 20c57f1318cd4c73b2248b2d02896176 and project 69e39fae43c341798f00e3b48f20d003. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:38:12.906883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-a3d76460-3a6a-4536-b370-d8a7b5ba0408 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Going to run 1 instances... {{(pid=123563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:38:12.909125 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-a3d76460-3a6a-4536-b370-d8a7b5ba0408 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9826e12-1d0c-4a5a-9616-338520403016',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:38:12.965430 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-a3d76460-3a6a-4536-b370-d8a7b5ba0408 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.707426 May 16 20:38:12.971480 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 76/156] 10.222.0.49 () {60 vars in 1146 bytes} [Mon May 16 20:38:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 20:38:12.977774 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-937cd7fd-6ae0-4994-b1c4-20a0e10ce10c tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:12.978962 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-937cd7fd-6ae0-4994-b1c4-20a0e10ce10c tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:13.037021 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-937cd7fd-6ae0-4994-b1c4-20a0e10ce10c tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:13.045512 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-937cd7fd-6ae0-4994-b1c4-20a0e10ce10c tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1222 microversion: 2.1 time: 0.073274 May 16 20:38:13.046562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 81/157] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:12 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1222 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:14.075083 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-d53c2dfe-f862-4341-a7f6-10ea24095e24 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:14.076730 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-d53c2dfe-f862-4341-a7f6-10ea24095e24 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:14.101028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d53c2dfe-f862-4341-a7f6-10ea24095e24 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:14.101249 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d53c2dfe-f862-4341-a7f6-10ea24095e24 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:14.107896 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d53c2dfe-f862-4341-a7f6-10ea24095e24 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:14.108994 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d53c2dfe-f862-4341-a7f6-10ea24095e24 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:14.246911 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d53c2dfe-f862-4341-a7f6-10ea24095e24 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:14.259765 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-d53c2dfe-f862-4341-a7f6-10ea24095e24 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1274 microversion: 2.1 time: 0.191941 May 16 20:38:14.262279 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 77/158] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:14 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1274 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:15.278819 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-af1a4c8b-ddbf-4779-a0c9-d19163cb1bda tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:15.279441 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-af1a4c8b-ddbf-4779-a0c9-d19163cb1bda tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:15.288813 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-af1a4c8b-ddbf-4779-a0c9-d19163cb1bda tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:15.289517 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-af1a4c8b-ddbf-4779-a0c9-d19163cb1bda tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:15.290471 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-af1a4c8b-ddbf-4779-a0c9-d19163cb1bda tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:15.291497 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-af1a4c8b-ddbf-4779-a0c9-d19163cb1bda tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:15.460497 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-af1a4c8b-ddbf-4779-a0c9-d19163cb1bda tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:15.468691 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-af1a4c8b-ddbf-4779-a0c9-d19163cb1bda tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1280 microversion: 2.1 time: 0.193846 May 16 20:38:15.481351 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 82/159] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:15 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1280 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:16.488663 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-a520875f-f10a-480d-bf49-d7fd1423db87 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:16.490206 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-a520875f-f10a-480d-bf49-d7fd1423db87 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:16.505481 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a520875f-f10a-480d-bf49-d7fd1423db87 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:16.507324 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a520875f-f10a-480d-bf49-d7fd1423db87 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:16.512105 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a520875f-f10a-480d-bf49-d7fd1423db87 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:16.512821 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a520875f-f10a-480d-bf49-d7fd1423db87 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:16.608794 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-6bb421fd-df95-4caa-9354-c999c820ed3a req-864a2e6c-3371-40ab-b01b-0642c800412f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d02eea51-3d7f-45e0-83ee-349ebd8121f8", "tag": "635fb22a-138e-46f9-9e24-14a4fd81ffc2"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:38:16.625454 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-6bb421fd-df95-4caa-9354-c999c820ed3a req-864a2e6c-3371-40ab-b01b-0642c800412f service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:16.626782 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-6bb421fd-df95-4caa-9354-c999c820ed3a req-864a2e6c-3371-40ab-b01b-0642c800412f service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:16.654290 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-6bb421fd-df95-4caa-9354-c999c820ed3a req-864a2e6c-3371-40ab-b01b-0642c800412f service nova] Creating event network-changed:635fb22a-138e-46f9-9e24-14a4fd81ffc2 for instance d02eea51-3d7f-45e0-83ee-349ebd8121f8 on hv-cinder-77703 May 16 20:38:16.676250 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-6bb421fd-df95-4caa-9354-c999c820ed3a req-864a2e6c-3371-40ab-b01b-0642c800412f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071735 May 16 20:38:16.679323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 83/160] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:38:16.901622 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a520875f-f10a-480d-bf49-d7fd1423db87 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:16.909213 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-a520875f-f10a-480d-bf49-d7fd1423db87 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1322 microversion: 2.1 time: 0.424687 May 16 20:38:16.913419 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 78/161] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:16 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1322 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:17.282023 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-814031fa-fd9a-492c-b127-f46b1b88c26f req-8b2ad36c-302b-4911-8624-84a0990558f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "547bc788-bd6c-4d26-b0aa-abecbd4615fc", "tag": "664c3d5e-8f87-4842-ba25-1e2046af5e41"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:38:17.297027 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-814031fa-fd9a-492c-b127-f46b1b88c26f req-8b2ad36c-302b-4911-8624-84a0990558f0 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:17.297542 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-814031fa-fd9a-492c-b127-f46b1b88c26f req-8b2ad36c-302b-4911-8624-84a0990558f0 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:17.325645 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-814031fa-fd9a-492c-b127-f46b1b88c26f req-8b2ad36c-302b-4911-8624-84a0990558f0 service nova] Creating event network-changed:664c3d5e-8f87-4842-ba25-1e2046af5e41 for instance 547bc788-bd6c-4d26-b0aa-abecbd4615fc on hv-cinder-77703 May 16 20:38:17.331578 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-814031fa-fd9a-492c-b127-f46b1b88c26f req-8b2ad36c-302b-4911-8624-84a0990558f0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055680 May 16 20:38:17.333077 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 84/162] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:38:17.931908 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-74a8debf-f519-491f-89be-569848b6af20 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:17.932899 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-74a8debf-f519-491f-89be-569848b6af20 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:17.940341 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-74a8debf-f519-491f-89be-569848b6af20 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:17.941042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-74a8debf-f519-491f-89be-569848b6af20 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:17.941859 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-74a8debf-f519-491f-89be-569848b6af20 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:17.942330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-74a8debf-f519-491f-89be-569848b6af20 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:18.090715 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-74a8debf-f519-491f-89be-569848b6af20 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:18.098121 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-74a8debf-f519-491f-89be-569848b6af20 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1322 microversion: 2.1 time: 0.171762 May 16 20:38:18.098883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 79/163] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:17 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:38:19.114803 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-81a1ed61-7e6b-4b9a-8359-6020fa420fa1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:19.115566 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-81a1ed61-7e6b-4b9a-8359-6020fa420fa1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:19.122176 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-81a1ed61-7e6b-4b9a-8359-6020fa420fa1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:19.122740 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-81a1ed61-7e6b-4b9a-8359-6020fa420fa1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:19.123804 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-81a1ed61-7e6b-4b9a-8359-6020fa420fa1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:19.124341 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-81a1ed61-7e6b-4b9a-8359-6020fa420fa1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:19.268961 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-81a1ed61-7e6b-4b9a-8359-6020fa420fa1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:19.276245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-81a1ed61-7e6b-4b9a-8359-6020fa420fa1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1322 microversion: 2.1 time: 0.165849 May 16 20:38:19.276841 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 85/164] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:19 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:20.293997 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-952757a3-0fc2-4985-99ba-3898a0e77125 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:20.294766 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-952757a3-0fc2-4985-99ba-3898a0e77125 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:20.304475 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-952757a3-0fc2-4985-99ba-3898a0e77125 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:20.305235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-952757a3-0fc2-4985-99ba-3898a0e77125 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:20.306257 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-952757a3-0fc2-4985-99ba-3898a0e77125 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:20.306742 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-952757a3-0fc2-4985-99ba-3898a0e77125 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:20.446917 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-952757a3-0fc2-4985-99ba-3898a0e77125 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:20.454835 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-952757a3-0fc2-4985-99ba-3898a0e77125 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1322 microversion: 2.1 time: 0.165702 May 16 20:38:20.455396 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 80/165] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:20 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:21.473428 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-89bc611a-b76d-4322-b05b-758932a33c57 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:21.475106 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-89bc611a-b76d-4322-b05b-758932a33c57 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:21.483357 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-89bc611a-b76d-4322-b05b-758932a33c57 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:21.484405 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-89bc611a-b76d-4322-b05b-758932a33c57 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:21.486398 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-89bc611a-b76d-4322-b05b-758932a33c57 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:21.487409 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-89bc611a-b76d-4322-b05b-758932a33c57 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:21.657967 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-89bc611a-b76d-4322-b05b-758932a33c57 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:21.661516 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-89bc611a-b76d-4322-b05b-758932a33c57 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1322 microversion: 2.1 time: 0.192939 May 16 20:38:21.662106 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 86/166] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:21 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:22.680457 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-90a6bd7e-6215-4d15-9023-a8284616381a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:22.681238 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-90a6bd7e-6215-4d15-9023-a8284616381a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:22.690930 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-90a6bd7e-6215-4d15-9023-a8284616381a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:22.691653 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-90a6bd7e-6215-4d15-9023-a8284616381a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:22.692200 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-90a6bd7e-6215-4d15-9023-a8284616381a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:22.697751 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-90a6bd7e-6215-4d15-9023-a8284616381a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:22.928153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-90a6bd7e-6215-4d15-9023-a8284616381a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:22.936177 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-90a6bd7e-6215-4d15-9023-a8284616381a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1322 microversion: 2.1 time: 0.260956 May 16 20:38:22.936791 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 81/167] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:22 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:23.953056 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e84414e3-2553-4f0c-8577-d8ab1c8acf39 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:23.954194 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-e84414e3-2553-4f0c-8577-d8ab1c8acf39 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:23.960189 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e84414e3-2553-4f0c-8577-d8ab1c8acf39 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:23.960867 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e84414e3-2553-4f0c-8577-d8ab1c8acf39 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:23.961767 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e84414e3-2553-4f0c-8577-d8ab1c8acf39 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:23.962197 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e84414e3-2553-4f0c-8577-d8ab1c8acf39 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:24.116053 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e84414e3-2553-4f0c-8577-d8ab1c8acf39 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:24.124042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-e84414e3-2553-4f0c-8577-d8ab1c8acf39 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1322 microversion: 2.1 time: 0.174653 May 16 20:38:24.131571 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 87/168] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:23 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:24.868906 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-cf32d465-b887-40aa-9adc-6b664bc1b8e2 req-e45c9d3f-311d-4240-b98a-2a751416dc53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02eea51-3d7f-45e0-83ee-349ebd8121f8", "name": "network-vif-plugged", "status": "completed", "tag": "635fb22a-138e-46f9-9e24-14a4fd81ffc2"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:38:24.877655 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-cf32d465-b887-40aa-9adc-6b664bc1b8e2 req-e45c9d3f-311d-4240-b98a-2a751416dc53 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:24.878183 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-cf32d465-b887-40aa-9adc-6b664bc1b8e2 req-e45c9d3f-311d-4240-b98a-2a751416dc53 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:24.889837 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-cf32d465-b887-40aa-9adc-6b664bc1b8e2 req-e45c9d3f-311d-4240-b98a-2a751416dc53 service nova] Creating event network-vif-plugged:635fb22a-138e-46f9-9e24-14a4fd81ffc2 for instance d02eea51-3d7f-45e0-83ee-349ebd8121f8 on hv-cinder-77703 May 16 20:38:24.901141 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-cf32d465-b887-40aa-9adc-6b664bc1b8e2 req-e45c9d3f-311d-4240-b98a-2a751416dc53 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036182 May 16 20:38:24.901939 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 82/169] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:38:25.142469 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a2414149-bb1c-4ea9-8915-784be60065b1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:25.143493 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-a2414149-bb1c-4ea9-8915-784be60065b1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:25.151059 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a2414149-bb1c-4ea9-8915-784be60065b1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:25.151480 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a2414149-bb1c-4ea9-8915-784be60065b1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:25.152513 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a2414149-bb1c-4ea9-8915-784be60065b1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:25.152958 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a2414149-bb1c-4ea9-8915-784be60065b1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:25.295700 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a2414149-bb1c-4ea9-8915-784be60065b1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:25.310453 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-a2414149-bb1c-4ea9-8915-784be60065b1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1322 microversion: 2.1 time: 0.171780 May 16 20:38:25.321155 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 88/170] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:25 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:26.328413 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-b62a05fb-8d7f-460e-ae57-8276ed5ff6ab tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:26.329626 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-b62a05fb-8d7f-460e-ae57-8276ed5ff6ab tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:26.337801 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b62a05fb-8d7f-460e-ae57-8276ed5ff6ab tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:26.342059 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b62a05fb-8d7f-460e-ae57-8276ed5ff6ab tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:26.343933 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b62a05fb-8d7f-460e-ae57-8276ed5ff6ab tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:26.344405 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b62a05fb-8d7f-460e-ae57-8276ed5ff6ab tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:26.501791 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-b62a05fb-8d7f-460e-ae57-8276ed5ff6ab tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:26.510559 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-b62a05fb-8d7f-460e-ae57-8276ed5ff6ab tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1322 microversion: 2.1 time: 0.186647 May 16 20:38:26.520494 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 83/171] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:26 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:27.013864 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-f82951d4-fe55-4903-870f-a48b83d7706f req-b4c57ef2-e762-4159-b272-7ccbdaaac1b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "547bc788-bd6c-4d26-b0aa-abecbd4615fc", "name": "network-vif-plugged", "status": "completed", "tag": "664c3d5e-8f87-4842-ba25-1e2046af5e41"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:38:27.024482 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-f82951d4-fe55-4903-870f-a48b83d7706f req-b4c57ef2-e762-4159-b272-7ccbdaaac1b8 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:27.024791 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-f82951d4-fe55-4903-870f-a48b83d7706f req-b4c57ef2-e762-4159-b272-7ccbdaaac1b8 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:27.038375 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-f82951d4-fe55-4903-870f-a48b83d7706f req-b4c57ef2-e762-4159-b272-7ccbdaaac1b8 service nova] Creating event network-vif-plugged:664c3d5e-8f87-4842-ba25-1e2046af5e41 for instance 547bc788-bd6c-4d26-b0aa-abecbd4615fc on hv-cinder-77703 May 16 20:38:27.043878 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-f82951d4-fe55-4903-870f-a48b83d7706f req-b4c57ef2-e762-4159-b272-7ccbdaaac1b8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034164 May 16 20:38:27.044746 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 89/172] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:38:27.528218 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-4025cd55-12a6-430a-9dec-bdc20b82b6bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:27.529197 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-4025cd55-12a6-430a-9dec-bdc20b82b6bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:27.537152 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4025cd55-12a6-430a-9dec-bdc20b82b6bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:27.537919 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4025cd55-12a6-430a-9dec-bdc20b82b6bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:27.538802 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4025cd55-12a6-430a-9dec-bdc20b82b6bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:27.539312 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4025cd55-12a6-430a-9dec-bdc20b82b6bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:27.674089 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-4025cd55-12a6-430a-9dec-bdc20b82b6bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:27.682325 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-4025cd55-12a6-430a-9dec-bdc20b82b6bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1322 microversion: 2.1 time: 0.158023 May 16 20:38:27.683147 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 84/173] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:27 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:28.699966 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-2948848e-3dfa-43ba-a7e3-a4adfd3e2d18 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:28.700693 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-2948848e-3dfa-43ba-a7e3-a4adfd3e2d18 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:28.707002 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2948848e-3dfa-43ba-a7e3-a4adfd3e2d18 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:28.707454 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2948848e-3dfa-43ba-a7e3-a4adfd3e2d18 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:28.708224 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2948848e-3dfa-43ba-a7e3-a4adfd3e2d18 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:28.708680 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2948848e-3dfa-43ba-a7e3-a4adfd3e2d18 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:28.867125 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2948848e-3dfa-43ba-a7e3-a4adfd3e2d18 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:28.875579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-2948848e-3dfa-43ba-a7e3-a4adfd3e2d18 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1322 microversion: 2.1 time: 0.179473 May 16 20:38:28.877271 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 90/174] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:28 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:29.894048 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-dcf99d67-ac81-4fd6-b63e-52ded5078d10 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:29.894830 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-dcf99d67-ac81-4fd6-b63e-52ded5078d10 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:29.901777 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dcf99d67-ac81-4fd6-b63e-52ded5078d10 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:29.902228 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dcf99d67-ac81-4fd6-b63e-52ded5078d10 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:29.903042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dcf99d67-ac81-4fd6-b63e-52ded5078d10 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:29.903425 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dcf99d67-ac81-4fd6-b63e-52ded5078d10 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:30.288822 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-dcf99d67-ac81-4fd6-b63e-52ded5078d10 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:30.296727 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-dcf99d67-ac81-4fd6-b63e-52ded5078d10 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1322 microversion: 2.1 time: 0.406472 May 16 20:38:30.297304 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 85/175] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:29 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1322 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:31.314270 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-84cfb0fb-54ac-4297-b2f8-f85df495ef11 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:31.314818 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-84cfb0fb-54ac-4297-b2f8-f85df495ef11 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:31.321185 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-84cfb0fb-54ac-4297-b2f8-f85df495ef11 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:31.321615 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-84cfb0fb-54ac-4297-b2f8-f85df495ef11 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:31.322387 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-84cfb0fb-54ac-4297-b2f8-f85df495ef11 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:31.322825 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-84cfb0fb-54ac-4297-b2f8-f85df495ef11 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:31.457422 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-84cfb0fb-54ac-4297-b2f8-f85df495ef11 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:31.465226 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-84cfb0fb-54ac-4297-b2f8-f85df495ef11 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1322 microversion: 2.1 time: 0.154929 May 16 20:38:31.465843 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 91/176] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:31 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:32.201790 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-93a27cf3-3642-4c1d-9919-699dbda7dbb1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:32.202355 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-93a27cf3-3642-4c1d-9919-699dbda7dbb1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:32.215952 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-93a27cf3-3642-4c1d-9919-699dbda7dbb1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:32.216460 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-93a27cf3-3642-4c1d-9919-699dbda7dbb1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:32.217270 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-93a27cf3-3642-4c1d-9919-699dbda7dbb1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:32.217712 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-93a27cf3-3642-4c1d-9919-699dbda7dbb1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:32.242634 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-93a27cf3-3642-4c1d-9919-699dbda7dbb1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752/ips" status: 200 len: 151 microversion: 2.1 time: 0.045683 May 16 20:38:32.243192 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 86/177] 10.222.0.49 () {58 vars in 1247 bytes} [Mon May 16 20:38:32 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:38:32.482020 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-f406d99c-6abd-4f33-b56e-fb379ba8524d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:32.482953 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-f406d99c-6abd-4f33-b56e-fb379ba8524d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:32.489683 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f406d99c-6abd-4f33-b56e-fb379ba8524d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:32.490119 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f406d99c-6abd-4f33-b56e-fb379ba8524d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:32.490877 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f406d99c-6abd-4f33-b56e-fb379ba8524d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:32.491300 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f406d99c-6abd-4f33-b56e-fb379ba8524d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:32.625152 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-fe3e71ff-ac4c-45ca-ae2b-c4a75f334762 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:32.625753 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-fe3e71ff-ac4c-45ca-ae2b-c4a75f334762 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:32.632156 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fe3e71ff-ac4c-45ca-ae2b-c4a75f334762 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:32.633164 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fe3e71ff-ac4c-45ca-ae2b-c4a75f334762 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:32.634513 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fe3e71ff-ac4c-45ca-ae2b-c4a75f334762 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:32.635195 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fe3e71ff-ac4c-45ca-ae2b-c4a75f334762 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:32.643561 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-f406d99c-6abd-4f33-b56e-fb379ba8524d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:32.651020 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-f406d99c-6abd-4f33-b56e-fb379ba8524d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1322 microversion: 2.1 time: 0.172837 May 16 20:38:32.651755 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 92/178] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:32 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:32.664044 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-fe3e71ff-ac4c-45ca-ae2b-c4a75f334762 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c/ips" status: 200 len: 152 microversion: 2.20 time: 0.044883 May 16 20:38:32.664853 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 87/179] 10.222.0.49 () {60 vars in 1288 bytes} [Mon May 16 20:38:32 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c/ips => generated 152 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 20:38:33.667715 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-3953d388-27cf-4ff7-9336-632610a0cd48 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:33.668314 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-3953d388-27cf-4ff7-9336-632610a0cd48 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:33.674903 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3953d388-27cf-4ff7-9336-632610a0cd48 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:33.675319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3953d388-27cf-4ff7-9336-632610a0cd48 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:33.676111 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3953d388-27cf-4ff7-9336-632610a0cd48 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:33.676946 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3953d388-27cf-4ff7-9336-632610a0cd48 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:33.806585 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3953d388-27cf-4ff7-9336-632610a0cd48 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:33.814568 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-3953d388-27cf-4ff7-9336-632610a0cd48 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1322 microversion: 2.1 time: 0.150729 May 16 20:38:33.815138 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 93/180] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:33 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:34.831017 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-baf8d5fb-5539-4583-afe5-d98497f2ba22 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:34.831634 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-baf8d5fb-5539-4583-afe5-d98497f2ba22 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:34.838214 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-baf8d5fb-5539-4583-afe5-d98497f2ba22 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:34.838660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-baf8d5fb-5539-4583-afe5-d98497f2ba22 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:34.839422 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-baf8d5fb-5539-4583-afe5-d98497f2ba22 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:34.839852 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-baf8d5fb-5539-4583-afe5-d98497f2ba22 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:34.967492 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-baf8d5fb-5539-4583-afe5-d98497f2ba22 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:34.978395 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-baf8d5fb-5539-4583-afe5-d98497f2ba22 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1322 microversion: 2.1 time: 0.150834 May 16 20:38:34.979084 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 88/181] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:34 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:35.995888 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-5e211c1d-fac1-4d75-9707-3ee7d2dbae5b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:35.996428 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-5e211c1d-fac1-4d75-9707-3ee7d2dbae5b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:36.002775 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5e211c1d-fac1-4d75-9707-3ee7d2dbae5b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:36.003216 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5e211c1d-fac1-4d75-9707-3ee7d2dbae5b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:36.003977 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5e211c1d-fac1-4d75-9707-3ee7d2dbae5b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:36.004396 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5e211c1d-fac1-4d75-9707-3ee7d2dbae5b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:36.135752 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-5e211c1d-fac1-4d75-9707-3ee7d2dbae5b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:36.143420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-5e211c1d-fac1-4d75-9707-3ee7d2dbae5b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1322 microversion: 2.1 time: 0.151639 May 16 20:38:36.143977 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 94/182] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:35 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:36.776707 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-3289409c-7f2a-4477-8328-d90f957605a0 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf3dd65c-238f-49c0-af99-eed77cce339b"}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:38:36.777766 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-3289409c-7f2a-4477-8328-d90f957605a0 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:36.784299 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3289409c-7f2a-4477-8328-d90f957605a0 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:36.784787 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3289409c-7f2a-4477-8328-d90f957605a0 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:36.785561 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3289409c-7f2a-4477-8328-d90f957605a0 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:36.785991 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3289409c-7f2a-4477-8328-d90f957605a0 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:37.049775 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-3289409c-7f2a-4477-8328-d90f957605a0 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "POST /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276970 May 16 20:38:37.050532 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 89/183] 10.222.0.49 () {60 vars in 1322 bytes} [Mon May 16 20:38:36 2022] POST /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:38:37.161256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-82564055-29a8-4a73-83f9-0914f1297a12 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:37.162162 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-82564055-29a8-4a73-83f9-0914f1297a12 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:37.168798 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-82564055-29a8-4a73-83f9-0914f1297a12 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:37.169239 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-82564055-29a8-4a73-83f9-0914f1297a12 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:37.170005 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-82564055-29a8-4a73-83f9-0914f1297a12 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:37.170443 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-82564055-29a8-4a73-83f9-0914f1297a12 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:37.312709 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-82564055-29a8-4a73-83f9-0914f1297a12 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:37.320359 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-82564055-29a8-4a73-83f9-0914f1297a12 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1516 microversion: 2.1 time: 0.163567 May 16 20:38:37.320976 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 95/184] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:37 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:37.339562 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-6dfc7367-bc8b-43c5-a2f3-742746ac0cd3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:38:37.340729 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-6dfc7367-bc8b-43c5-a2f3-742746ac0cd3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:37.347590 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6dfc7367-bc8b-43c5-a2f3-742746ac0cd3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:37.348213 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6dfc7367-bc8b-43c5-a2f3-742746ac0cd3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:37.349265 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6dfc7367-bc8b-43c5-a2f3-742746ac0cd3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:37.349739 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6dfc7367-bc8b-43c5-a2f3-742746ac0cd3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:37.372356 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.objects.instance [None req-6dfc7367-bc8b-43c5-a2f3-742746ac0cd3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lazy-loading 'flavor' on Instance uuid 547bc788-bd6c-4d26-b0aa-abecbd4615fc {{(pid=123563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:38:37.487116 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-6dfc7367-bc8b-43c5-a2f3-742746ac0cd3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "POST /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc/action" status: 200 len: 32 microversion: 2.1 time: 0.152673 May 16 20:38:37.488073 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 90/185] 10.222.0.49 () {60 vars in 1277 bytes} [Mon May 16 20:38:37 2022] POST /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc/action => generated 32 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 20:38:37.508845 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-cb763f4e-22d9-4903-9000-40d1f660ef26 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:37.509897 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-cb763f4e-22d9-4903-9000-40d1f660ef26 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:37.516928 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cb763f4e-22d9-4903-9000-40d1f660ef26 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:37.517445 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cb763f4e-22d9-4903-9000-40d1f660ef26 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:37.518297 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cb763f4e-22d9-4903-9000-40d1f660ef26 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:37.519018 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cb763f4e-22d9-4903-9000-40d1f660ef26 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:37.649364 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-cb763f4e-22d9-4903-9000-40d1f660ef26 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:37.660322 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-cb763f4e-22d9-4903-9000-40d1f660ef26 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.166633 May 16 20:38:37.661132 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 96/186] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:37 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:37.717966 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-00589c93-c1fc-47e0-92bc-01be4ed77c9c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:38:37.718508 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-00589c93-c1fc-47e0-92bc-01be4ed77c9c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:37.726215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-00589c93-c1fc-47e0-92bc-01be4ed77c9c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:37.726672 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-00589c93-c1fc-47e0-92bc-01be4ed77c9c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:37.727440 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-00589c93-c1fc-47e0-92bc-01be4ed77c9c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:37.727876 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-00589c93-c1fc-47e0-92bc-01be4ed77c9c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:37.750363 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.objects.instance [None req-00589c93-c1fc-47e0-92bc-01be4ed77c9c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lazy-loading 'flavor' on Instance uuid 6f8d450f-828f-4002-b649-ff13d14a047c {{(pid=123563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:38:38.035486 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-00589c93-c1fc-47e0-92bc-01be4ed77c9c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "POST /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c/action" status: 202 len: 0 microversion: 2.20 time: 0.321816 May 16 20:38:38.036118 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 91/187] 10.222.0.49 () {62 vars in 1318 bytes} [Mon May 16 20:38:37 2022] POST /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 20:38:38.044694 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-720245dc-f699-4359-b4cb-e9092139ea17 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:38.045336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-720245dc-f699-4359-b4cb-e9092139ea17 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:38.056305 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-720245dc-f699-4359-b4cb-e9092139ea17 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:38.056952 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-720245dc-f699-4359-b4cb-e9092139ea17 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:38.058089 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-720245dc-f699-4359-b4cb-e9092139ea17 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:38.058556 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-720245dc-f699-4359-b4cb-e9092139ea17 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:38.191363 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-720245dc-f699-4359-b4cb-e9092139ea17 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:38.199303 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-720245dc-f699-4359-b4cb-e9092139ea17 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:38.200818 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-720245dc-f699-4359-b4cb-e9092139ea17 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:38.201973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-720245dc-f699-4359-b4cb-e9092139ea17 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1723 microversion: 2.20 time: 0.161438 May 16 20:38:38.202543 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 97/188] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:38:38 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:38:38.679374 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-dcc99f8d-b2fa-400b-88e8-26ebfcca45bd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:38.680007 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-dcc99f8d-b2fa-400b-88e8-26ebfcca45bd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:38.687202 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dcc99f8d-b2fa-400b-88e8-26ebfcca45bd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:38.687652 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dcc99f8d-b2fa-400b-88e8-26ebfcca45bd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:38.688408 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dcc99f8d-b2fa-400b-88e8-26ebfcca45bd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:38.688863 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dcc99f8d-b2fa-400b-88e8-26ebfcca45bd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:38.820389 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-dcc99f8d-b2fa-400b-88e8-26ebfcca45bd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:38.828332 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-dcc99f8d-b2fa-400b-88e8-26ebfcca45bd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.154242 May 16 20:38:38.828925 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 92/189] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:38 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:39.223972 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-65e871eb-66d5-45ca-bb68-f386a5aef08d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:39.225139 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-65e871eb-66d5-45ca-bb68-f386a5aef08d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:39.235528 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-65e871eb-66d5-45ca-bb68-f386a5aef08d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:39.236268 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-65e871eb-66d5-45ca-bb68-f386a5aef08d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:39.237280 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-65e871eb-66d5-45ca-bb68-f386a5aef08d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:39.237802 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-65e871eb-66d5-45ca-bb68-f386a5aef08d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:39.372706 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-65e871eb-66d5-45ca-bb68-f386a5aef08d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:39.381224 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-65e871eb-66d5-45ca-bb68-f386a5aef08d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:39.382716 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-65e871eb-66d5-45ca-bb68-f386a5aef08d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:39.383913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-65e871eb-66d5-45ca-bb68-f386a5aef08d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1723 microversion: 2.20 time: 0.166709 May 16 20:38:39.384570 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 98/190] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:38:39 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:38:39.847011 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-8b0c0553-6499-4671-a135-e92d53c41319 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:39.847601 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-8b0c0553-6499-4671-a135-e92d53c41319 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:39.854685 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8b0c0553-6499-4671-a135-e92d53c41319 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:39.855140 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8b0c0553-6499-4671-a135-e92d53c41319 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:39.855907 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8b0c0553-6499-4671-a135-e92d53c41319 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:39.856344 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8b0c0553-6499-4671-a135-e92d53c41319 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:40.151191 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-8b0c0553-6499-4671-a135-e92d53c41319 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:40.161403 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-8b0c0553-6499-4671-a135-e92d53c41319 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.317959 May 16 20:38:40.162182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 93/191] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:39 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:40.402395 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-42ca228c-b1cc-49cd-91b6-aeaec610e051 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:40.402971 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-42ca228c-b1cc-49cd-91b6-aeaec610e051 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:40.409548 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-42ca228c-b1cc-49cd-91b6-aeaec610e051 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:40.409993 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-42ca228c-b1cc-49cd-91b6-aeaec610e051 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:40.410754 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-42ca228c-b1cc-49cd-91b6-aeaec610e051 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:40.411177 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-42ca228c-b1cc-49cd-91b6-aeaec610e051 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:40.544335 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-42ca228c-b1cc-49cd-91b6-aeaec610e051 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:40.554040 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-42ca228c-b1cc-49cd-91b6-aeaec610e051 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:40.555751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-42ca228c-b1cc-49cd-91b6-aeaec610e051 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:40.556962 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-42ca228c-b1cc-49cd-91b6-aeaec610e051 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1723 microversion: 2.20 time: 0.158515 May 16 20:38:40.557520 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 99/192] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:38:40 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:38:41.179032 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-90cb916d-00e3-4ff2-8a5e-42c2d6c86214 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:41.179666 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-90cb916d-00e3-4ff2-8a5e-42c2d6c86214 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:41.186469 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-90cb916d-00e3-4ff2-8a5e-42c2d6c86214 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:41.186917 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-90cb916d-00e3-4ff2-8a5e-42c2d6c86214 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:41.187689 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-90cb916d-00e3-4ff2-8a5e-42c2d6c86214 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:41.188096 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-90cb916d-00e3-4ff2-8a5e-42c2d6c86214 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:41.337690 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-90cb916d-00e3-4ff2-8a5e-42c2d6c86214 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:41.346704 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-90cb916d-00e3-4ff2-8a5e-42c2d6c86214 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.171850 May 16 20:38:41.347601 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 94/193] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:41 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:41.575282 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e888e157-a3f7-4028-bb08-26558a098b32 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:41.575893 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-e888e157-a3f7-4028-bb08-26558a098b32 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:41.582374 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e888e157-a3f7-4028-bb08-26558a098b32 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:41.582733 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e888e157-a3f7-4028-bb08-26558a098b32 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:41.583563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e888e157-a3f7-4028-bb08-26558a098b32 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:41.584045 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e888e157-a3f7-4028-bb08-26558a098b32 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:41.719068 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e888e157-a3f7-4028-bb08-26558a098b32 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:41.727565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e888e157-a3f7-4028-bb08-26558a098b32 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:41.729392 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e888e157-a3f7-4028-bb08-26558a098b32 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:41.730726 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-e888e157-a3f7-4028-bb08-26558a098b32 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1723 microversion: 2.20 time: 0.159438 May 16 20:38:41.731378 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 100/194] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:38:41 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:38:42.363810 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-57a04c57-376e-4105-acfe-dc439037de9b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:42.364449 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-57a04c57-376e-4105-acfe-dc439037de9b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:42.372280 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-57a04c57-376e-4105-acfe-dc439037de9b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:42.372933 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-57a04c57-376e-4105-acfe-dc439037de9b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:42.373901 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-57a04c57-376e-4105-acfe-dc439037de9b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:42.374493 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-57a04c57-376e-4105-acfe-dc439037de9b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:42.535331 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-57a04c57-376e-4105-acfe-dc439037de9b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:42.543807 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-57a04c57-376e-4105-acfe-dc439037de9b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.183908 May 16 20:38:42.544785 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 95/195] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:42 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:42.755478 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-75b7fa20-e0d2-4f7a-bee8-9469c83426df tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:42.756228 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-75b7fa20-e0d2-4f7a-bee8-9469c83426df tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:42.766320 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-75b7fa20-e0d2-4f7a-bee8-9469c83426df tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:42.766822 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-75b7fa20-e0d2-4f7a-bee8-9469c83426df tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:42.767816 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-75b7fa20-e0d2-4f7a-bee8-9469c83426df tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:42.768639 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-75b7fa20-e0d2-4f7a-bee8-9469c83426df tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:42.914699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-75b7fa20-e0d2-4f7a-bee8-9469c83426df tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:42.922666 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-75b7fa20-e0d2-4f7a-bee8-9469c83426df tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:42.924130 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-75b7fa20-e0d2-4f7a-bee8-9469c83426df tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:42.925354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-75b7fa20-e0d2-4f7a-bee8-9469c83426df tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1723 microversion: 2.20 time: 0.179912 May 16 20:38:42.925894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 101/196] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:38:42 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:38:43.561930 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-f2f0774a-ab6d-477c-8862-ec1072d01a28 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:43.562533 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-f2f0774a-ab6d-477c-8862-ec1072d01a28 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:43.569260 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f2f0774a-ab6d-477c-8862-ec1072d01a28 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:43.569710 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f2f0774a-ab6d-477c-8862-ec1072d01a28 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:43.570612 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f2f0774a-ab6d-477c-8862-ec1072d01a28 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:43.571143 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f2f0774a-ab6d-477c-8862-ec1072d01a28 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:43.706525 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f2f0774a-ab6d-477c-8862-ec1072d01a28 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:43.714055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-f2f0774a-ab6d-477c-8862-ec1072d01a28 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.156045 May 16 20:38:43.714627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 96/197] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:43 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:43.948973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-ae3b34a6-9a70-4374-b17a-69d199766252 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:43.950065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-ae3b34a6-9a70-4374-b17a-69d199766252 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:43.960298 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ae3b34a6-9a70-4374-b17a-69d199766252 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:43.961065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ae3b34a6-9a70-4374-b17a-69d199766252 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:43.961836 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ae3b34a6-9a70-4374-b17a-69d199766252 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:43.962263 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ae3b34a6-9a70-4374-b17a-69d199766252 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:44.096430 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-ae3b34a6-9a70-4374-b17a-69d199766252 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:44.104926 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-ae3b34a6-9a70-4374-b17a-69d199766252 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:44.106420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-ae3b34a6-9a70-4374-b17a-69d199766252 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:44.107584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-ae3b34a6-9a70-4374-b17a-69d199766252 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1723 microversion: 2.20 time: 0.165439 May 16 20:38:44.108149 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 102/198] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:38:43 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:38:44.734958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2aad58d3-1f8f-4e5b-a013-392a9397a530 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:44.735968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-2aad58d3-1f8f-4e5b-a013-392a9397a530 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:44.745110 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2aad58d3-1f8f-4e5b-a013-392a9397a530 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:44.745565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2aad58d3-1f8f-4e5b-a013-392a9397a530 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:44.746338 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2aad58d3-1f8f-4e5b-a013-392a9397a530 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:44.746777 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2aad58d3-1f8f-4e5b-a013-392a9397a530 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:44.878813 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-2aad58d3-1f8f-4e5b-a013-392a9397a530 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:44.887438 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-2aad58d3-1f8f-4e5b-a013-392a9397a530 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.158917 May 16 20:38:44.887793 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 97/199] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:44 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:45.126743 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-1573cdf6-5954-4b3d-811c-27b467344690 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:45.127349 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-1573cdf6-5954-4b3d-811c-27b467344690 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:45.134222 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1573cdf6-5954-4b3d-811c-27b467344690 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:45.134666 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1573cdf6-5954-4b3d-811c-27b467344690 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:45.135437 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1573cdf6-5954-4b3d-811c-27b467344690 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:45.135867 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1573cdf6-5954-4b3d-811c-27b467344690 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:45.267660 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-1573cdf6-5954-4b3d-811c-27b467344690 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:45.275647 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-1573cdf6-5954-4b3d-811c-27b467344690 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:45.277155 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-1573cdf6-5954-4b3d-811c-27b467344690 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:45.278367 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-1573cdf6-5954-4b3d-811c-27b467344690 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1723 microversion: 2.20 time: 0.156114 May 16 20:38:45.278973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 103/200] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:38:45 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:38:45.907244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-f5f74579-5fd3-4d40-97f4-ba1bd9125f14 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:45.908257 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-f5f74579-5fd3-4d40-97f4-ba1bd9125f14 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:45.917259 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f5f74579-5fd3-4d40-97f4-ba1bd9125f14 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:45.917709 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f5f74579-5fd3-4d40-97f4-ba1bd9125f14 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:45.918490 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f5f74579-5fd3-4d40-97f4-ba1bd9125f14 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:45.918922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f5f74579-5fd3-4d40-97f4-ba1bd9125f14 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:46.046146 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f5f74579-5fd3-4d40-97f4-ba1bd9125f14 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:46.055664 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-f5f74579-5fd3-4d40-97f4-ba1bd9125f14 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.154624 May 16 20:38:46.056462 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 98/201] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:45 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:46.300292 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-2853324d-d1a1-4129-9086-681e153b2b92 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:46.301749 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-2853324d-d1a1-4129-9086-681e153b2b92 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:46.309200 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2853324d-d1a1-4129-9086-681e153b2b92 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:46.309635 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2853324d-d1a1-4129-9086-681e153b2b92 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:46.310432 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2853324d-d1a1-4129-9086-681e153b2b92 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:46.310861 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2853324d-d1a1-4129-9086-681e153b2b92 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:46.441851 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2853324d-d1a1-4129-9086-681e153b2b92 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:46.450334 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2853324d-d1a1-4129-9086-681e153b2b92 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:46.451894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2853324d-d1a1-4129-9086-681e153b2b92 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:46.453134 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-2853324d-d1a1-4129-9086-681e153b2b92 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1723 microversion: 2.20 time: 0.159314 May 16 20:38:46.453736 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 104/202] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:38:46 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:38:47.072607 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-646cdd9f-d13a-475c-827a-932ef6e0b71d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:47.073982 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-646cdd9f-d13a-475c-827a-932ef6e0b71d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:47.081572 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-646cdd9f-d13a-475c-827a-932ef6e0b71d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:47.082036 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-646cdd9f-d13a-475c-827a-932ef6e0b71d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:47.082885 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-646cdd9f-d13a-475c-827a-932ef6e0b71d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:47.083633 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-646cdd9f-d13a-475c-827a-932ef6e0b71d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:47.241488 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-646cdd9f-d13a-475c-827a-932ef6e0b71d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:47.249670 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-646cdd9f-d13a-475c-827a-932ef6e0b71d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.181119 May 16 20:38:47.250632 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 99/203] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:47 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:47.477943 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-648cb019-9f3b-4c1d-9a07-46009a87f024 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:47.478568 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-648cb019-9f3b-4c1d-9a07-46009a87f024 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:47.486467 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-648cb019-9f3b-4c1d-9a07-46009a87f024 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:47.486903 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-648cb019-9f3b-4c1d-9a07-46009a87f024 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:47.487678 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-648cb019-9f3b-4c1d-9a07-46009a87f024 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:47.488100 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-648cb019-9f3b-4c1d-9a07-46009a87f024 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:47.625530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-648cb019-9f3b-4c1d-9a07-46009a87f024 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:47.633796 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-648cb019-9f3b-4c1d-9a07-46009a87f024 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:47.635247 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-648cb019-9f3b-4c1d-9a07-46009a87f024 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:47.636407 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-648cb019-9f3b-4c1d-9a07-46009a87f024 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1723 microversion: 2.20 time: 0.169081 May 16 20:38:47.636978 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 105/204] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:38:47 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:38:47.769359 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-538e5aa4-fbe5-4b72-8750-5caa454b8445 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Action: 'create', calling method: .version_select at 0x7f81b14f2310>, body: {"keypair": {"name": "tempest-keypair-347139245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5WlQ3aBs5i01j5Xs0JnIpH2sklfnPbqTo2/EAwgTdYHiqQPPi0Ag5gJ6W/Mv7F73XtYwVhMANctjXwCuHjW3AUN/NO4KEOEmnyYb6/gYvBXIKCsQXqt6fynnc6JHY22w=="}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:38:47.786500 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-538e5aa4-fbe5-4b72-8750-5caa454b8445 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Getting quotas for project 2beaab3a72a345d98a9ec4e0ae4686b6. Resources: {'key_pairs'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:38:47.791371 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-538e5aa4-fbe5-4b72-8750-5caa454b8445 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Getting quotas for user b578680e88c741bda2c8e56b2dc9d335 and project 2beaab3a72a345d98a9ec4e0ae4686b6. Resources: {'key_pairs'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:38:47.819153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-538e5aa4-fbe5-4b72-8750-5caa454b8445 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055555 May 16 20:38:47.820165 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 100/205] 10.222.0.49 () {60 vars in 1158 bytes} [Mon May 16 20:38:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:38:48.267505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-2a84b36a-c93c-49d5-9ec9-a794fed076ec tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:48.268188 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-2a84b36a-c93c-49d5-9ec9-a794fed076ec tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:48.274508 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2a84b36a-c93c-49d5-9ec9-a794fed076ec tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:48.275032 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2a84b36a-c93c-49d5-9ec9-a794fed076ec tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:48.275975 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2a84b36a-c93c-49d5-9ec9-a794fed076ec tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:48.276460 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2a84b36a-c93c-49d5-9ec9-a794fed076ec tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:48.458075 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2a84b36a-c93c-49d5-9ec9-a794fed076ec tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:48.469366 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-2a84b36a-c93c-49d5-9ec9-a794fed076ec tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.206015 May 16 20:38:48.470492 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 106/206] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:48 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:48.654629 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7ef78831-659b-4025-8fd0-dff4377037fb tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:48.655956 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-7ef78831-659b-4025-8fd0-dff4377037fb tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:48.663660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7ef78831-659b-4025-8fd0-dff4377037fb tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:48.664128 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7ef78831-659b-4025-8fd0-dff4377037fb tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:48.664935 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7ef78831-659b-4025-8fd0-dff4377037fb tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:48.665748 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7ef78831-659b-4025-8fd0-dff4377037fb tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:48.808893 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-7ef78831-659b-4025-8fd0-dff4377037fb tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:48.819065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-7ef78831-659b-4025-8fd0-dff4377037fb tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:48.822113 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-7ef78831-659b-4025-8fd0-dff4377037fb tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:48.823528 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-7ef78831-659b-4025-8fd0-dff4377037fb tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1723 microversion: 2.20 time: 0.173234 May 16 20:38:48.824090 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 101/207] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:38:48 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:38:49.205642 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-b336d806-38b7-4589-9b8b-2607dea58d07 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-666563105", "imageRef": "f9826e12-1d0c-4a5a-9616-338520403016", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51755a9b-e432-418d-95c4-023d6854f406"}], "security_groups": [{"name": "tempest-securitygroup--52788363"}], "key_name": "tempest-keypair-347139245", "user_data": "}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:38:49.311631 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.network.neutron [None req-b336d806-38b7-4589-9b8b-2607dea58d07 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] validate_networks() for [('51755a9b-e432-418d-95c4-023d6854f406', None, None, None, None, None)] {{(pid=123564) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:38:49.488254 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-289ce6e8-5f5a-4422-ae67-892b78a81cd7 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:49.488819 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-289ce6e8-5f5a-4422-ae67-892b78a81cd7 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:49.512845 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-289ce6e8-5f5a-4422-ae67-892b78a81cd7 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:49.513598 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-289ce6e8-5f5a-4422-ae67-892b78a81cd7 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:49.514676 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-289ce6e8-5f5a-4422-ae67-892b78a81cd7 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:49.515386 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-289ce6e8-5f5a-4422-ae67-892b78a81cd7 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:49.737740 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-289ce6e8-5f5a-4422-ae67-892b78a81cd7 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:49.747194 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-289ce6e8-5f5a-4422-ae67-892b78a81cd7 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.264175 May 16 20:38:49.747895 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 102/208] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:49 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:49.802328 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-b336d806-38b7-4589-9b8b-2607dea58d07 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Flavor limits 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:38:49.802821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-b336d806-38b7-4589-9b8b-2607dea58d07 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Image limits 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:38:49.803410 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-b336d806-38b7-4589-9b8b-2607dea58d07 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Flavor pref 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:38:49.803890 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-b336d806-38b7-4589-9b8b-2607dea58d07 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Image pref 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:38:49.804371 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-b336d806-38b7-4589-9b8b-2607dea58d07 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:38:49.815373 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b336d806-38b7-4589-9b8b-2607dea58d07 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:49.815914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b336d806-38b7-4589-9b8b-2607dea58d07 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:49.817632 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b336d806-38b7-4589-9b8b-2607dea58d07 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:49.818278 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b336d806-38b7-4589-9b8b-2607dea58d07 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:49.842749 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0b1a6999-8096-4e8f-a684-b6955a292299 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:49.843357 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0b1a6999-8096-4e8f-a684-b6955a292299 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:49.847067 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-b336d806-38b7-4589-9b8b-2607dea58d07 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Getting quotas for project 2beaab3a72a345d98a9ec4e0ae4686b6. Resources: {'cores', 'ram', 'instances'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:38:49.852390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0b1a6999-8096-4e8f-a684-b6955a292299 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:49.852904 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0b1a6999-8096-4e8f-a684-b6955a292299 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:49.855301 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0b1a6999-8096-4e8f-a684-b6955a292299 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:49.858120 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-b336d806-38b7-4589-9b8b-2607dea58d07 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Getting quotas for user b578680e88c741bda2c8e56b2dc9d335 and project 2beaab3a72a345d98a9ec4e0ae4686b6. Resources: {'cores', 'ram', 'instances'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:38:49.860564 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0b1a6999-8096-4e8f-a684-b6955a292299 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:49.875760 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-b336d806-38b7-4589-9b8b-2607dea58d07 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Going to run 1 instances... {{(pid=123564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:38:49.878226 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-b336d806-38b7-4589-9b8b-2607dea58d07 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9826e12-1d0c-4a5a-9616-338520403016',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:38:49.927061 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-b336d806-38b7-4589-9b8b-2607dea58d07 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.725786 May 16 20:38:49.932654 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 107/209] 10.222.0.49 () {60 vars in 1146 bytes} [Mon May 16 20:38:49 2022] POST /compute/v2.1/servers => generated 400 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 20:38:49.939561 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6436a58e-d936-47eb-a35e-d6e591515393 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:49.941345 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-6436a58e-d936-47eb-a35e-d6e591515393 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:50.014621 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6436a58e-d936-47eb-a35e-d6e591515393 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:50.024310 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-6436a58e-d936-47eb-a35e-d6e591515393 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1240 microversion: 2.1 time: 0.089411 May 16 20:38:50.027209 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 108/210] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:49 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:50.054150 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-0b1a6999-8096-4e8f-a684-b6955a292299 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:50.064704 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-0b1a6999-8096-4e8f-a684-b6955a292299 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:50.066271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-0b1a6999-8096-4e8f-a684-b6955a292299 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:50.067829 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0b1a6999-8096-4e8f-a684-b6955a292299 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1723 microversion: 2.20 time: 0.229096 May 16 20:38:50.068406 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 103/211] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:38:49 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:38:50.765242 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-49c36aa7-2e06-4783-8d5a-f9c283bf32a2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:50.765937 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-49c36aa7-2e06-4783-8d5a-f9c283bf32a2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:50.771861 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-49c36aa7-2e06-4783-8d5a-f9c283bf32a2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:50.772374 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-49c36aa7-2e06-4783-8d5a-f9c283bf32a2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:50.773639 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-49c36aa7-2e06-4783-8d5a-f9c283bf32a2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:50.774137 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-49c36aa7-2e06-4783-8d5a-f9c283bf32a2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:50.908211 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-49c36aa7-2e06-4783-8d5a-f9c283bf32a2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:50.918776 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-49c36aa7-2e06-4783-8d5a-f9c283bf32a2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.157116 May 16 20:38:50.919901 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 109/212] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:50 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:51.043666 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-b606fbb4-5e05-41e4-8100-247c048de3cb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:51.044293 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-b606fbb4-5e05-41e4-8100-247c048de3cb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:51.052765 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b606fbb4-5e05-41e4-8100-247c048de3cb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:51.053201 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b606fbb4-5e05-41e4-8100-247c048de3cb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:51.058290 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b606fbb4-5e05-41e4-8100-247c048de3cb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:51.058844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b606fbb4-5e05-41e4-8100-247c048de3cb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:51.086614 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-ebdfd1f1-2211-4998-83b7-e42983b204c7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:51.087697 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-ebdfd1f1-2211-4998-83b7-e42983b204c7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:51.094573 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ebdfd1f1-2211-4998-83b7-e42983b204c7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:51.095296 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ebdfd1f1-2211-4998-83b7-e42983b204c7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:51.096218 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ebdfd1f1-2211-4998-83b7-e42983b204c7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:51.096870 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ebdfd1f1-2211-4998-83b7-e42983b204c7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:51.132548 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-b606fbb4-5e05-41e4-8100-247c048de3cb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:51.140803 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-b606fbb4-5e05-41e4-8100-247c048de3cb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1300 microversion: 2.1 time: 0.101181 May 16 20:38:51.141593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 104/213] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:51 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1300 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:38:51.244281 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-ebdfd1f1-2211-4998-83b7-e42983b204c7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:51.252319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-ebdfd1f1-2211-4998-83b7-e42983b204c7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:51.253880 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-ebdfd1f1-2211-4998-83b7-e42983b204c7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:51.255049 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-ebdfd1f1-2211-4998-83b7-e42983b204c7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1723 microversion: 2.20 time: 0.173204 May 16 20:38:51.255607 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 110/214] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:38:51 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:38:51.936992 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-ba7ab509-a346-49a4-a1ff-22e901bf3c19 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:51.941008 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-ba7ab509-a346-49a4-a1ff-22e901bf3c19 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:51.949399 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ba7ab509-a346-49a4-a1ff-22e901bf3c19 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:51.950079 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ba7ab509-a346-49a4-a1ff-22e901bf3c19 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:51.951261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ba7ab509-a346-49a4-a1ff-22e901bf3c19 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:51.952282 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ba7ab509-a346-49a4-a1ff-22e901bf3c19 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:52.106728 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ba7ab509-a346-49a4-a1ff-22e901bf3c19 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:52.114811 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-ba7ab509-a346-49a4-a1ff-22e901bf3c19 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.181849 May 16 20:38:52.123893 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 105/215] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:51 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:52.160606 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6020ed50-7119-4b14-a7fa-b3931d339bde tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:52.161246 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-6020ed50-7119-4b14-a7fa-b3931d339bde tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:52.170383 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6020ed50-7119-4b14-a7fa-b3931d339bde tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:52.171401 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6020ed50-7119-4b14-a7fa-b3931d339bde tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:52.172207 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6020ed50-7119-4b14-a7fa-b3931d339bde tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:52.173349 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6020ed50-7119-4b14-a7fa-b3931d339bde tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:52.273502 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-e7543ca6-3f4c-4ee9-b9e6-778b2d83b5d9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:52.274124 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-e7543ca6-3f4c-4ee9-b9e6-778b2d83b5d9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:52.280293 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e7543ca6-3f4c-4ee9-b9e6-778b2d83b5d9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:52.280799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e7543ca6-3f4c-4ee9-b9e6-778b2d83b5d9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:52.281585 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e7543ca6-3f4c-4ee9-b9e6-778b2d83b5d9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:52.282036 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e7543ca6-3f4c-4ee9-b9e6-778b2d83b5d9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:52.317309 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6020ed50-7119-4b14-a7fa-b3931d339bde tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:52.325917 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-6020ed50-7119-4b14-a7fa-b3931d339bde tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1364 microversion: 2.1 time: 0.171117 May 16 20:38:52.327319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 111/216] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:52 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:52.465405 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-e7543ca6-3f4c-4ee9-b9e6-778b2d83b5d9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:52.475060 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-e7543ca6-3f4c-4ee9-b9e6-778b2d83b5d9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:52.477673 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-e7543ca6-3f4c-4ee9-b9e6-778b2d83b5d9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:52.479031 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-e7543ca6-3f4c-4ee9-b9e6-778b2d83b5d9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1723 microversion: 2.20 time: 0.209881 May 16 20:38:52.480119 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 106/217] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:38:52 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:38:52.727965 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-8aba5e89-32b1-4e66-b108-ab0333021af9 req-8cca7b63-710e-4c5a-a7a8-bdb65c953cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36eca126-3242-483f-a941-432265ebaf50", "tag": "b91c820c-8c4e-4967-8610-a735537dcff4"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:38:52.740251 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-8aba5e89-32b1-4e66-b108-ab0333021af9 req-8cca7b63-710e-4c5a-a7a8-bdb65c953cc5 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:52.740724 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-8aba5e89-32b1-4e66-b108-ab0333021af9 req-8cca7b63-710e-4c5a-a7a8-bdb65c953cc5 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:52.763156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-8aba5e89-32b1-4e66-b108-ab0333021af9 req-8cca7b63-710e-4c5a-a7a8-bdb65c953cc5 service nova] Creating event network-changed:b91c820c-8c4e-4967-8610-a735537dcff4 for instance 36eca126-3242-483f-a941-432265ebaf50 on hv-cinder-77703 May 16 20:38:52.769360 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-8aba5e89-32b1-4e66-b108-ab0333021af9 req-8cca7b63-710e-4c5a-a7a8-bdb65c953cc5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045550 May 16 20:38:52.770729 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 112/218] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:38:53.131940 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-64e85fa8-3159-43ef-ac05-9876776242d9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:53.132671 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-64e85fa8-3159-43ef-ac05-9876776242d9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:53.139195 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-64e85fa8-3159-43ef-ac05-9876776242d9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:53.139649 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-64e85fa8-3159-43ef-ac05-9876776242d9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:53.140462 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-64e85fa8-3159-43ef-ac05-9876776242d9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:53.140893 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-64e85fa8-3159-43ef-ac05-9876776242d9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:53.273350 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-64e85fa8-3159-43ef-ac05-9876776242d9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:53.280937 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-64e85fa8-3159-43ef-ac05-9876776242d9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.153385 May 16 20:38:53.281510 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 107/219] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:53 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:53.348359 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-7c317348-822a-4060-b69d-2efbdb748821 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:53.349097 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-7c317348-822a-4060-b69d-2efbdb748821 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:53.356315 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7c317348-822a-4060-b69d-2efbdb748821 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:53.356794 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7c317348-822a-4060-b69d-2efbdb748821 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:53.357566 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7c317348-822a-4060-b69d-2efbdb748821 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:53.357972 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7c317348-822a-4060-b69d-2efbdb748821 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:53.491203 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-7c317348-822a-4060-b69d-2efbdb748821 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:53.500370 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-1c0299c4-fc43-47bd-b937-69b384b19a13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:53.500370 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-1c0299c4-fc43-47bd-b937-69b384b19a13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:53.500583 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-7c317348-822a-4060-b69d-2efbdb748821 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1364 microversion: 2.1 time: 0.157350 May 16 20:38:53.500583 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 113/220] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:53 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:53.507756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1c0299c4-fc43-47bd-b937-69b384b19a13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:53.508118 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1c0299c4-fc43-47bd-b937-69b384b19a13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:53.509189 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1c0299c4-fc43-47bd-b937-69b384b19a13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:53.509652 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1c0299c4-fc43-47bd-b937-69b384b19a13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:53.640504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-1c0299c4-fc43-47bd-b937-69b384b19a13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:53.649095 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-1c0299c4-fc43-47bd-b937-69b384b19a13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:53.650599 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-1c0299c4-fc43-47bd-b937-69b384b19a13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:53.651807 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-1c0299c4-fc43-47bd-b937-69b384b19a13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1723 microversion: 2.20 time: 0.157887 May 16 20:38:53.652370 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 108/221] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:38:53 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:38:54.302968 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-2839909b-ddd3-48fa-8cfe-920fc3fa153a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:54.303909 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-2839909b-ddd3-48fa-8cfe-920fc3fa153a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:54.314247 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2839909b-ddd3-48fa-8cfe-920fc3fa153a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:54.314986 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2839909b-ddd3-48fa-8cfe-920fc3fa153a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:54.316248 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2839909b-ddd3-48fa-8cfe-920fc3fa153a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:54.317042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2839909b-ddd3-48fa-8cfe-920fc3fa153a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:54.457583 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2839909b-ddd3-48fa-8cfe-920fc3fa153a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:54.465790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-2839909b-ddd3-48fa-8cfe-920fc3fa153a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.170223 May 16 20:38:54.466398 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 114/222] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:54 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:54.514956 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-62a1e5a7-0df6-437a-ab66-9efff081450a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:54.515609 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-62a1e5a7-0df6-437a-ab66-9efff081450a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:54.522255 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-62a1e5a7-0df6-437a-ab66-9efff081450a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:54.522820 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-62a1e5a7-0df6-437a-ab66-9efff081450a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:54.523593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-62a1e5a7-0df6-437a-ab66-9efff081450a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:54.524030 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-62a1e5a7-0df6-437a-ab66-9efff081450a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:54.654667 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-62a1e5a7-0df6-437a-ab66-9efff081450a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:54.662584 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-62a1e5a7-0df6-437a-ab66-9efff081450a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1364 microversion: 2.1 time: 0.151417 May 16 20:38:54.663428 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 109/223] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:54 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:54.670353 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e63a3eb4-82c3-4f87-a948-e7361a43d869 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:54.671002 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-e63a3eb4-82c3-4f87-a948-e7361a43d869 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:54.677457 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e63a3eb4-82c3-4f87-a948-e7361a43d869 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:54.677905 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e63a3eb4-82c3-4f87-a948-e7361a43d869 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:54.678922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e63a3eb4-82c3-4f87-a948-e7361a43d869 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:54.679547 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e63a3eb4-82c3-4f87-a948-e7361a43d869 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:54.809218 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e63a3eb4-82c3-4f87-a948-e7361a43d869 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:54.817581 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e63a3eb4-82c3-4f87-a948-e7361a43d869 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:54.819074 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e63a3eb4-82c3-4f87-a948-e7361a43d869 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:54.820332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-e63a3eb4-82c3-4f87-a948-e7361a43d869 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1723 microversion: 2.20 time: 0.154394 May 16 20:38:54.820926 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 115/224] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:38:54 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:38:55.487042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-67a17f2c-664e-43fe-8291-a0c2fbc48822 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:55.488051 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-67a17f2c-664e-43fe-8291-a0c2fbc48822 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:55.498723 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-67a17f2c-664e-43fe-8291-a0c2fbc48822 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:55.499470 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-67a17f2c-664e-43fe-8291-a0c2fbc48822 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:55.500826 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-67a17f2c-664e-43fe-8291-a0c2fbc48822 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:55.501562 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-67a17f2c-664e-43fe-8291-a0c2fbc48822 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:55.631199 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-67a17f2c-664e-43fe-8291-a0c2fbc48822 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:55.639088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-67a17f2c-664e-43fe-8291-a0c2fbc48822 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.158685 May 16 20:38:55.639690 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 110/225] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:55 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:55.679749 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e01d8b33-b726-48ff-9431-ce300336fe2b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:55.682068 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-e01d8b33-b726-48ff-9431-ce300336fe2b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:55.695074 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e01d8b33-b726-48ff-9431-ce300336fe2b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:55.695735 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e01d8b33-b726-48ff-9431-ce300336fe2b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:55.698778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e01d8b33-b726-48ff-9431-ce300336fe2b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:55.699220 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e01d8b33-b726-48ff-9431-ce300336fe2b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:55.831448 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e01d8b33-b726-48ff-9431-ce300336fe2b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:55.838757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-d513ad58-bd54-4919-a9b7-ea27bba49222 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:55.839298 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-e01d8b33-b726-48ff-9431-ce300336fe2b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1364 microversion: 2.1 time: 0.163818 May 16 20:38:55.839433 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-d513ad58-bd54-4919-a9b7-ea27bba49222 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:55.839862 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 116/226] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:55 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:55.845600 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d513ad58-bd54-4919-a9b7-ea27bba49222 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:55.846048 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d513ad58-bd54-4919-a9b7-ea27bba49222 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:55.846816 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d513ad58-bd54-4919-a9b7-ea27bba49222 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:55.847328 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d513ad58-bd54-4919-a9b7-ea27bba49222 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:55.978702 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d513ad58-bd54-4919-a9b7-ea27bba49222 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:55.987075 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d513ad58-bd54-4919-a9b7-ea27bba49222 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:55.988613 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d513ad58-bd54-4919-a9b7-ea27bba49222 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:55.989925 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-d513ad58-bd54-4919-a9b7-ea27bba49222 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1723 microversion: 2.20 time: 0.155098 May 16 20:38:55.990800 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 111/227] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:38:55 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:38:56.655530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-f1659376-62c7-4d34-bc8c-330fb9eb9516 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:56.656389 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-f1659376-62c7-4d34-bc8c-330fb9eb9516 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:56.667036 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f1659376-62c7-4d34-bc8c-330fb9eb9516 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:56.667478 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f1659376-62c7-4d34-bc8c-330fb9eb9516 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:56.668527 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f1659376-62c7-4d34-bc8c-330fb9eb9516 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:56.668961 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f1659376-62c7-4d34-bc8c-330fb9eb9516 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:56.799948 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-f1659376-62c7-4d34-bc8c-330fb9eb9516 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:56.810552 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-f1659376-62c7-4d34-bc8c-330fb9eb9516 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.159011 May 16 20:38:56.811221 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 117/228] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:56 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:56.856405 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-991f0879-a0e7-43ee-a2fa-a2cf5bc323d3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:56.857051 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-991f0879-a0e7-43ee-a2fa-a2cf5bc323d3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:56.863800 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-991f0879-a0e7-43ee-a2fa-a2cf5bc323d3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:56.864279 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-991f0879-a0e7-43ee-a2fa-a2cf5bc323d3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:56.865092 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-991f0879-a0e7-43ee-a2fa-a2cf5bc323d3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:56.865522 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-991f0879-a0e7-43ee-a2fa-a2cf5bc323d3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:57.000853 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-991f0879-a0e7-43ee-a2fa-a2cf5bc323d3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:57.008526 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-1160ea21-4baf-4459-a940-9b939dc49d77 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:57.009395 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-1160ea21-4baf-4459-a940-9b939dc49d77 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:57.019852 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1160ea21-4baf-4459-a940-9b939dc49d77 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:57.021698 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1160ea21-4baf-4459-a940-9b939dc49d77 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:57.022505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1160ea21-4baf-4459-a940-9b939dc49d77 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:57.022940 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1160ea21-4baf-4459-a940-9b939dc49d77 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:57.023354 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-991f0879-a0e7-43ee-a2fa-a2cf5bc323d3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1364 microversion: 2.1 time: 0.169459 May 16 20:38:57.025145 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 112/229] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:56 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:57.199164 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-1160ea21-4baf-4459-a940-9b939dc49d77 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:57.207451 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-1160ea21-4baf-4459-a940-9b939dc49d77 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:57.208978 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-1160ea21-4baf-4459-a940-9b939dc49d77 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:57.210145 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-1160ea21-4baf-4459-a940-9b939dc49d77 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1744 microversion: 2.20 time: 0.205950 May 16 20:38:57.210709 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 118/230] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:38:57 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1744 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:38:57.831538 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-174893b6-5f67-49ef-b9e9-f65af4715eea tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:57.832550 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-174893b6-5f67-49ef-b9e9-f65af4715eea tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:57.842749 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-174893b6-5f67-49ef-b9e9-f65af4715eea tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:57.843485 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-174893b6-5f67-49ef-b9e9-f65af4715eea tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:57.844793 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-174893b6-5f67-49ef-b9e9-f65af4715eea tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:57.845496 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-174893b6-5f67-49ef-b9e9-f65af4715eea tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:57.977469 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-174893b6-5f67-49ef-b9e9-f65af4715eea tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:57.985805 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-174893b6-5f67-49ef-b9e9-f65af4715eea tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.160790 May 16 20:38:57.986388 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 113/231] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:57 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:58.045524 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-46b43536-bcb2-4477-ad3d-98d1f77c2738 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:58.046536 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-46b43536-bcb2-4477-ad3d-98d1f77c2738 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:58.057155 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-46b43536-bcb2-4477-ad3d-98d1f77c2738 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:58.057600 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-46b43536-bcb2-4477-ad3d-98d1f77c2738 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:58.058371 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-46b43536-bcb2-4477-ad3d-98d1f77c2738 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:58.058830 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-46b43536-bcb2-4477-ad3d-98d1f77c2738 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:58.196534 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-46b43536-bcb2-4477-ad3d-98d1f77c2738 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:58.203929 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-46b43536-bcb2-4477-ad3d-98d1f77c2738 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1364 microversion: 2.1 time: 0.164850 May 16 20:38:58.204613 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 119/232] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:58 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:58.230176 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-db316d9c-c37b-4bdf-8ec9-ab175ac48f32 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:58.230868 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-db316d9c-c37b-4bdf-8ec9-ab175ac48f32 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:58.237540 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-db316d9c-c37b-4bdf-8ec9-ab175ac48f32 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:58.238066 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-db316d9c-c37b-4bdf-8ec9-ab175ac48f32 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:58.238909 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-db316d9c-c37b-4bdf-8ec9-ab175ac48f32 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:58.239416 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-db316d9c-c37b-4bdf-8ec9-ab175ac48f32 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:58.375497 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-db316d9c-c37b-4bdf-8ec9-ab175ac48f32 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:58.386449 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-db316d9c-c37b-4bdf-8ec9-ab175ac48f32 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:58.387973 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-db316d9c-c37b-4bdf-8ec9-ab175ac48f32 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:58.389181 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-db316d9c-c37b-4bdf-8ec9-ab175ac48f32 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1744 microversion: 2.20 time: 0.163056 May 16 20:38:58.389745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 114/233] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:38:58 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:38:59.006351 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-f149751f-3f92-4bc7-a409-6f33cbce3398 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:59.007207 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-f149751f-3f92-4bc7-a409-6f33cbce3398 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:59.017582 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f149751f-3f92-4bc7-a409-6f33cbce3398 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:59.018312 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f149751f-3f92-4bc7-a409-6f33cbce3398 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:59.019558 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f149751f-3f92-4bc7-a409-6f33cbce3398 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:59.020264 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f149751f-3f92-4bc7-a409-6f33cbce3398 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:59.153748 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-f149751f-3f92-4bc7-a409-6f33cbce3398 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:59.161232 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-f149751f-3f92-4bc7-a409-6f33cbce3398 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.161477 May 16 20:38:59.161793 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 120/234] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:58 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:59.222101 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-62a6ea77-6ec7-4952-8581-a1096def03e5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:59.222665 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-62a6ea77-6ec7-4952-8581-a1096def03e5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:59.230815 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-62a6ea77-6ec7-4952-8581-a1096def03e5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:59.231364 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-62a6ea77-6ec7-4952-8581-a1096def03e5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:59.238914 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-62a6ea77-6ec7-4952-8581-a1096def03e5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:59.238914 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-62a6ea77-6ec7-4952-8581-a1096def03e5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:59.363383 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-62a6ea77-6ec7-4952-8581-a1096def03e5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:59.372318 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-62a6ea77-6ec7-4952-8581-a1096def03e5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1364 microversion: 2.1 time: 0.152898 May 16 20:38:59.373127 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 115/235] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:38:59 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:38:59.407257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-efb026ba-bfbe-43b5-9127-1d0792f3f55d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:38:59.407866 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-efb026ba-bfbe-43b5-9127-1d0792f3f55d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:38:59.414109 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-efb026ba-bfbe-43b5-9127-1d0792f3f55d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:59.414527 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-efb026ba-bfbe-43b5-9127-1d0792f3f55d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:59.415309 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-efb026ba-bfbe-43b5-9127-1d0792f3f55d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:38:59.415797 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-efb026ba-bfbe-43b5-9127-1d0792f3f55d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:38:59.550099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-efb026ba-bfbe-43b5-9127-1d0792f3f55d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:59.559061 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-efb026ba-bfbe-43b5-9127-1d0792f3f55d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:59.560566 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-efb026ba-bfbe-43b5-9127-1d0792f3f55d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:38:59.561725 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-efb026ba-bfbe-43b5-9127-1d0792f3f55d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1744 microversion: 2.20 time: 0.158412 May 16 20:38:59.562352 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 121/236] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:38:59 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:39:00.180223 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-26243d0c-a864-4183-b08a-99ba8d7dbb4f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:00.181033 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-26243d0c-a864-4183-b08a-99ba8d7dbb4f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:00.189270 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-26243d0c-a864-4183-b08a-99ba8d7dbb4f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:00.189836 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-26243d0c-a864-4183-b08a-99ba8d7dbb4f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:00.190792 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-26243d0c-a864-4183-b08a-99ba8d7dbb4f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:00.191333 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-26243d0c-a864-4183-b08a-99ba8d7dbb4f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:00.322942 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-26243d0c-a864-4183-b08a-99ba8d7dbb4f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:00.330345 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-26243d0c-a864-4183-b08a-99ba8d7dbb4f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.155436 May 16 20:39:00.330909 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 116/237] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:00 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:00.390052 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-900187b9-9b3c-47d5-a1e3-ee5594e6506f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:00.390675 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-900187b9-9b3c-47d5-a1e3-ee5594e6506f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:00.396971 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-900187b9-9b3c-47d5-a1e3-ee5594e6506f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:00.397452 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-900187b9-9b3c-47d5-a1e3-ee5594e6506f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:00.398216 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-900187b9-9b3c-47d5-a1e3-ee5594e6506f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:00.398642 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-900187b9-9b3c-47d5-a1e3-ee5594e6506f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:00.530733 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-900187b9-9b3c-47d5-a1e3-ee5594e6506f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:00.538185 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-900187b9-9b3c-47d5-a1e3-ee5594e6506f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1364 microversion: 2.1 time: 0.151923 May 16 20:39:00.544556 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 122/238] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:00 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:00.579597 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-8462e6a7-d6d1-4230-8b28-5778b0f349d9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:00.580140 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-8462e6a7-d6d1-4230-8b28-5778b0f349d9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:00.586308 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8462e6a7-d6d1-4230-8b28-5778b0f349d9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:00.586757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8462e6a7-d6d1-4230-8b28-5778b0f349d9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:00.587663 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8462e6a7-d6d1-4230-8b28-5778b0f349d9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:00.588095 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8462e6a7-d6d1-4230-8b28-5778b0f349d9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:00.723203 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-8462e6a7-d6d1-4230-8b28-5778b0f349d9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:00.731619 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-8462e6a7-d6d1-4230-8b28-5778b0f349d9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:00.733171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-8462e6a7-d6d1-4230-8b28-5778b0f349d9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:00.735131 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-8462e6a7-d6d1-4230-8b28-5778b0f349d9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1744 microversion: 2.20 time: 0.159776 May 16 20:39:00.735750 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 117/239] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:00 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:01.264329 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-6c16bde0-21bf-4b1f-a2ba-a27d7e025571 req-1634f59b-5c8c-45d9-870a-659917f31a68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8d450f-828f-4002-b649-ff13d14a047c", "name": "network-vif-plugged", "status": "completed", "tag": "6aa491fa-5223-4d44-b9ca-f8811045b0ad"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:39:01.282267 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-6c16bde0-21bf-4b1f-a2ba-a27d7e025571 req-1634f59b-5c8c-45d9-870a-659917f31a68 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:01.282695 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-6c16bde0-21bf-4b1f-a2ba-a27d7e025571 req-1634f59b-5c8c-45d9-870a-659917f31a68 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:01.295718 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-6c16bde0-21bf-4b1f-a2ba-a27d7e025571 req-1634f59b-5c8c-45d9-870a-659917f31a68 service nova] Creating event network-vif-plugged:6aa491fa-5223-4d44-b9ca-f8811045b0ad for instance 6f8d450f-828f-4002-b649-ff13d14a047c on hv-cinder-77703 May 16 20:39:01.301868 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-6c16bde0-21bf-4b1f-a2ba-a27d7e025571 req-1634f59b-5c8c-45d9-870a-659917f31a68 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045438 May 16 20:39:01.303096 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 123/240] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:39:01.350507 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-743a3a25-e52f-47aa-acfd-58b7e08c1190 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:01.351137 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-743a3a25-e52f-47aa-acfd-58b7e08c1190 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:01.362820 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-743a3a25-e52f-47aa-acfd-58b7e08c1190 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:01.363322 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-743a3a25-e52f-47aa-acfd-58b7e08c1190 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:01.364117 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-743a3a25-e52f-47aa-acfd-58b7e08c1190 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:01.368950 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-743a3a25-e52f-47aa-acfd-58b7e08c1190 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:01.559097 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-72d75a77-874d-407e-bbea-df4a835f69d2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:01.561673 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-72d75a77-874d-407e-bbea-df4a835f69d2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:01.573723 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-72d75a77-874d-407e-bbea-df4a835f69d2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:01.574258 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-72d75a77-874d-407e-bbea-df4a835f69d2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:01.575177 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-72d75a77-874d-407e-bbea-df4a835f69d2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:01.575985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-72d75a77-874d-407e-bbea-df4a835f69d2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:01.663276 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-743a3a25-e52f-47aa-acfd-58b7e08c1190 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:01.683337 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-743a3a25-e52f-47aa-acfd-58b7e08c1190 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.327192 May 16 20:39:01.683337 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 118/241] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:01 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:01.755886 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-868fc38c-11e7-4c14-92cb-11ab6760d13e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:01.757226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-868fc38c-11e7-4c14-92cb-11ab6760d13e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:01.769581 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-868fc38c-11e7-4c14-92cb-11ab6760d13e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:01.771268 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-868fc38c-11e7-4c14-92cb-11ab6760d13e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:01.772187 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-868fc38c-11e7-4c14-92cb-11ab6760d13e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:01.772789 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-868fc38c-11e7-4c14-92cb-11ab6760d13e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:01.905332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-72d75a77-874d-407e-bbea-df4a835f69d2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:01.917128 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-72d75a77-874d-407e-bbea-df4a835f69d2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1364 microversion: 2.1 time: 0.364154 May 16 20:39:01.918216 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 124/242] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:01 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1364 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:02.000524 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-868fc38c-11e7-4c14-92cb-11ab6760d13e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:02.014164 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-868fc38c-11e7-4c14-92cb-11ab6760d13e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:02.014164 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-868fc38c-11e7-4c14-92cb-11ab6760d13e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:02.014164 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-868fc38c-11e7-4c14-92cb-11ab6760d13e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1739 microversion: 2.20 time: 0.262011 May 16 20:39:02.015475 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 119/243] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:01 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:39:02.693631 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-558ac9b6-1b65-40ea-b880-3ca543ce06c3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:02.695527 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-558ac9b6-1b65-40ea-b880-3ca543ce06c3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:02.704294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-558ac9b6-1b65-40ea-b880-3ca543ce06c3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:02.704799 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-558ac9b6-1b65-40ea-b880-3ca543ce06c3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:02.707053 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-558ac9b6-1b65-40ea-b880-3ca543ce06c3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:02.707053 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-558ac9b6-1b65-40ea-b880-3ca543ce06c3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:02.909024 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-558ac9b6-1b65-40ea-b880-3ca543ce06c3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:02.917947 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-558ac9b6-1b65-40ea-b880-3ca543ce06c3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.228587 May 16 20:39:02.918530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 125/244] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:02 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:02.934530 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-15aca726-6526-429b-a4a4-bbb10fa7b76e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:02.935671 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-15aca726-6526-429b-a4a4-bbb10fa7b76e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:02.942235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-15aca726-6526-429b-a4a4-bbb10fa7b76e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:02.942685 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-15aca726-6526-429b-a4a4-bbb10fa7b76e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:02.943461 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-15aca726-6526-429b-a4a4-bbb10fa7b76e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:02.943893 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-15aca726-6526-429b-a4a4-bbb10fa7b76e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:03.032089 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-af9ed926-6818-4f1a-99c7-40a09ca19606 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:03.033018 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-af9ed926-6818-4f1a-99c7-40a09ca19606 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:03.047942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-af9ed926-6818-4f1a-99c7-40a09ca19606 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:03.048665 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-af9ed926-6818-4f1a-99c7-40a09ca19606 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:03.049605 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-af9ed926-6818-4f1a-99c7-40a09ca19606 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:03.050255 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-af9ed926-6818-4f1a-99c7-40a09ca19606 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:03.103394 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-15aca726-6526-429b-a4a4-bbb10fa7b76e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:03.118582 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-15aca726-6526-429b-a4a4-bbb10fa7b76e tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1364 microversion: 2.1 time: 0.187804 May 16 20:39:03.119173 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 120/245] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:02 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:03.256403 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-af9ed926-6818-4f1a-99c7-40a09ca19606 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:03.272540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-af9ed926-6818-4f1a-99c7-40a09ca19606 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:03.274453 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-af9ed926-6818-4f1a-99c7-40a09ca19606 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:03.276637 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-af9ed926-6818-4f1a-99c7-40a09ca19606 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1739 microversion: 2.20 time: 0.248971 May 16 20:39:03.291648 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 126/246] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:03 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:03.935888 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-a200a651-11ed-46b4-b9b2-eee7c2f89d38 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:03.937198 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-a200a651-11ed-46b4-b9b2-eee7c2f89d38 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:03.945722 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a200a651-11ed-46b4-b9b2-eee7c2f89d38 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:03.946176 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a200a651-11ed-46b4-b9b2-eee7c2f89d38 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:03.947072 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a200a651-11ed-46b4-b9b2-eee7c2f89d38 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:03.947505 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a200a651-11ed-46b4-b9b2-eee7c2f89d38 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:04.105372 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a200a651-11ed-46b4-b9b2-eee7c2f89d38 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:04.115780 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-a200a651-11ed-46b4-b9b2-eee7c2f89d38 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.184206 May 16 20:39:04.116372 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 121/247] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:03 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:04.135085 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-ca90bf46-7479-4e01-b547-65028043216f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:04.135831 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-ca90bf46-7479-4e01-b547-65028043216f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:04.142301 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ca90bf46-7479-4e01-b547-65028043216f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:04.142755 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ca90bf46-7479-4e01-b547-65028043216f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:04.143537 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ca90bf46-7479-4e01-b547-65028043216f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:04.143966 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ca90bf46-7479-4e01-b547-65028043216f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:04.286794 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-ca90bf46-7479-4e01-b547-65028043216f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:04.297611 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-ca90bf46-7479-4e01-b547-65028043216f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1364 microversion: 2.1 time: 0.166270 May 16 20:39:04.298588 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-174f6507-68ef-4701-a00c-7af03aa153cc tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:04.298997 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 127/248] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:04 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:04.307356 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-174f6507-68ef-4701-a00c-7af03aa153cc tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:04.313751 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-174f6507-68ef-4701-a00c-7af03aa153cc tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:04.314231 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-174f6507-68ef-4701-a00c-7af03aa153cc tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:04.315322 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-174f6507-68ef-4701-a00c-7af03aa153cc tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:04.316324 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-174f6507-68ef-4701-a00c-7af03aa153cc tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:04.464774 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-174f6507-68ef-4701-a00c-7af03aa153cc tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:04.472761 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-174f6507-68ef-4701-a00c-7af03aa153cc tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:04.474267 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-174f6507-68ef-4701-a00c-7af03aa153cc tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:04.475517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-174f6507-68ef-4701-a00c-7af03aa153cc tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1739 microversion: 2.20 time: 0.180941 May 16 20:39:04.486399 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 122/249] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:04 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:39:05.133002 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-f8b73475-483c-4660-9593-b870809128bf tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:05.133631 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-f8b73475-483c-4660-9593-b870809128bf tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:05.150525 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f8b73475-483c-4660-9593-b870809128bf tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:05.151261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f8b73475-483c-4660-9593-b870809128bf tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:05.151816 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f8b73475-483c-4660-9593-b870809128bf tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:05.152882 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f8b73475-483c-4660-9593-b870809128bf tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:05.315912 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7b07f2c5-add5-4cf6-bbd3-d48b92f8cde8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:05.316571 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-7b07f2c5-add5-4cf6-bbd3-d48b92f8cde8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:05.322803 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7b07f2c5-add5-4cf6-bbd3-d48b92f8cde8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:05.323490 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7b07f2c5-add5-4cf6-bbd3-d48b92f8cde8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:05.324461 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7b07f2c5-add5-4cf6-bbd3-d48b92f8cde8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:05.325054 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7b07f2c5-add5-4cf6-bbd3-d48b92f8cde8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:05.347697 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-f8b73475-483c-4660-9593-b870809128bf tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:05.357650 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-f8b73475-483c-4660-9593-b870809128bf tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.227251 May 16 20:39:05.361000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 128/250] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:05 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:05.384391 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-6b40a1c0-79a7-47cb-ae0a-878e106e5c7e req-0c468697-90c0-4ec6-9317-50c62653fa2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36eca126-3242-483f-a941-432265ebaf50", "name": "network-vif-plugged", "status": "completed", "tag": "b91c820c-8c4e-4967-8610-a735537dcff4"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:39:05.393278 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-6b40a1c0-79a7-47cb-ae0a-878e106e5c7e req-0c468697-90c0-4ec6-9317-50c62653fa2b service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:05.394295 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-6b40a1c0-79a7-47cb-ae0a-878e106e5c7e req-0c468697-90c0-4ec6-9317-50c62653fa2b service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:05.406598 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-6b40a1c0-79a7-47cb-ae0a-878e106e5c7e req-0c468697-90c0-4ec6-9317-50c62653fa2b service nova] Creating event network-vif-plugged:b91c820c-8c4e-4967-8610-a735537dcff4 for instance 36eca126-3242-483f-a941-432265ebaf50 on hv-cinder-77703 May 16 20:39:05.412123 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-6b40a1c0-79a7-47cb-ae0a-878e106e5c7e req-0c468697-90c0-4ec6-9317-50c62653fa2b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032055 May 16 20:39:05.413336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 129/251] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:39:05.495596 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-72d5448f-d5e6-4b22-bcea-bf2f5e6bb7c2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:05.496310 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-72d5448f-d5e6-4b22-bcea-bf2f5e6bb7c2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:05.496655 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-7b07f2c5-add5-4cf6-bbd3-d48b92f8cde8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:05.505428 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-7b07f2c5-add5-4cf6-bbd3-d48b92f8cde8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1364 microversion: 2.1 time: 0.194062 May 16 20:39:05.506333 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 123/252] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:05 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:05.516248 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-72d5448f-d5e6-4b22-bcea-bf2f5e6bb7c2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:05.518419 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-72d5448f-d5e6-4b22-bcea-bf2f5e6bb7c2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:05.519385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-72d5448f-d5e6-4b22-bcea-bf2f5e6bb7c2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:05.520497 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-72d5448f-d5e6-4b22-bcea-bf2f5e6bb7c2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:05.726030 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-72d5448f-d5e6-4b22-bcea-bf2f5e6bb7c2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:05.739067 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-72d5448f-d5e6-4b22-bcea-bf2f5e6bb7c2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:05.741034 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-72d5448f-d5e6-4b22-bcea-bf2f5e6bb7c2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:05.742571 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-72d5448f-d5e6-4b22-bcea-bf2f5e6bb7c2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1739 microversion: 2.20 time: 0.252486 May 16 20:39:05.743897 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 130/253] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:05 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:39:06.375461 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-79f45456-3d31-4a5d-8b73-8b4c41c27ba0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:06.376714 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-79f45456-3d31-4a5d-8b73-8b4c41c27ba0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:06.393356 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-79f45456-3d31-4a5d-8b73-8b4c41c27ba0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:06.393819 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-79f45456-3d31-4a5d-8b73-8b4c41c27ba0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:06.394613 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-79f45456-3d31-4a5d-8b73-8b4c41c27ba0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:06.395053 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-79f45456-3d31-4a5d-8b73-8b4c41c27ba0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:06.527329 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a01dcf20-de55-468d-b2a5-ca986a8fd561 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:06.527897 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-a01dcf20-de55-468d-b2a5-ca986a8fd561 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:06.538677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a01dcf20-de55-468d-b2a5-ca986a8fd561 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:06.539390 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a01dcf20-de55-468d-b2a5-ca986a8fd561 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:06.541407 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a01dcf20-de55-468d-b2a5-ca986a8fd561 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:06.542026 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a01dcf20-de55-468d-b2a5-ca986a8fd561 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:06.645654 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-79f45456-3d31-4a5d-8b73-8b4c41c27ba0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:06.659556 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-79f45456-3d31-4a5d-8b73-8b4c41c27ba0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.288366 May 16 20:39:06.660637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 124/254] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:06 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:06.761368 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-b232c810-2f73-4313-8666-4d02d291be15 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:06.762158 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-b232c810-2f73-4313-8666-4d02d291be15 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:06.769813 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b232c810-2f73-4313-8666-4d02d291be15 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:06.770468 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b232c810-2f73-4313-8666-4d02d291be15 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:06.771824 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b232c810-2f73-4313-8666-4d02d291be15 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:06.772362 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b232c810-2f73-4313-8666-4d02d291be15 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:06.834215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a01dcf20-de55-468d-b2a5-ca986a8fd561 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:06.845108 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-a01dcf20-de55-468d-b2a5-ca986a8fd561 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1364 microversion: 2.1 time: 0.321684 May 16 20:39:06.860380 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 131/255] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:06 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1364 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:06.984291 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-b232c810-2f73-4313-8666-4d02d291be15 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:06.994644 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-b232c810-2f73-4313-8666-4d02d291be15 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:06.996250 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-b232c810-2f73-4313-8666-4d02d291be15 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:06.997747 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-b232c810-2f73-4313-8666-4d02d291be15 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1739 microversion: 2.20 time: 0.240531 May 16 20:39:06.999471 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 125/256] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:06 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:39:07.680693 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-95e059aa-3d08-4f9b-9c24-5130578bf993 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:07.682081 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-95e059aa-3d08-4f9b-9c24-5130578bf993 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:07.700301 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-95e059aa-3d08-4f9b-9c24-5130578bf993 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:07.704874 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-95e059aa-3d08-4f9b-9c24-5130578bf993 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:07.707203 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-95e059aa-3d08-4f9b-9c24-5130578bf993 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:07.707822 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-95e059aa-3d08-4f9b-9c24-5130578bf993 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:07.867811 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-a77925a8-e12f-45af-a77f-e149bfc6ada5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:07.869419 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-a77925a8-e12f-45af-a77f-e149bfc6ada5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:07.883700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a77925a8-e12f-45af-a77f-e149bfc6ada5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:07.885905 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a77925a8-e12f-45af-a77f-e149bfc6ada5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:07.888087 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a77925a8-e12f-45af-a77f-e149bfc6ada5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:07.889815 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a77925a8-e12f-45af-a77f-e149bfc6ada5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:07.932076 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-95e059aa-3d08-4f9b-9c24-5130578bf993 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:07.941286 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-95e059aa-3d08-4f9b-9c24-5130578bf993 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.266033 May 16 20:39:07.944870 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 132/257] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:07 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:08.021156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-50bcb4ff-0e1e-4934-968b-7b1b5aaead69 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:08.021872 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-50bcb4ff-0e1e-4934-968b-7b1b5aaead69 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:08.028307 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-50bcb4ff-0e1e-4934-968b-7b1b5aaead69 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:08.028787 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-50bcb4ff-0e1e-4934-968b-7b1b5aaead69 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:08.029574 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-50bcb4ff-0e1e-4934-968b-7b1b5aaead69 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:08.030003 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-50bcb4ff-0e1e-4934-968b-7b1b5aaead69 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:08.104067 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a77925a8-e12f-45af-a77f-e149bfc6ada5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:08.112353 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-a77925a8-e12f-45af-a77f-e149bfc6ada5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1555 microversion: 2.1 time: 0.248714 May 16 20:39:08.113512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 126/258] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:07 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1555 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:39:08.139472 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-db2320df-5254-4cbc-b2e9-c633c9d96c23 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:08.145726 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-db2320df-5254-4cbc-b2e9-c633c9d96c23 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:08.173412 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-db2320df-5254-4cbc-b2e9-c633c9d96c23 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:08.174122 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-db2320df-5254-4cbc-b2e9-c633c9d96c23 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:08.175098 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-db2320df-5254-4cbc-b2e9-c633c9d96c23 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:08.175900 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-db2320df-5254-4cbc-b2e9-c633c9d96c23 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:08.310386 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-db2320df-5254-4cbc-b2e9-c633c9d96c23 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.180759 May 16 20:39:08.311145 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 127/259] 10.222.0.49 () {58 vars in 1274 bytes} [Mon May 16 20:39:08 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:39:08.338825 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-50bcb4ff-0e1e-4934-968b-7b1b5aaead69 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:08.347413 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-50bcb4ff-0e1e-4934-968b-7b1b5aaead69 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:08.349409 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-50bcb4ff-0e1e-4934-968b-7b1b5aaead69 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:08.350838 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-50bcb4ff-0e1e-4934-968b-7b1b5aaead69 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1739 microversion: 2.20 time: 0.333938 May 16 20:39:08.351334 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 133/260] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:08 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1739 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:39:08.959746 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-fdb81611-5856-4a6a-a499-719bb048efb6 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:08.960384 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-fdb81611-5856-4a6a-a499-719bb048efb6 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:08.966696 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fdb81611-5856-4a6a-a499-719bb048efb6 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:08.967335 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fdb81611-5856-4a6a-a499-719bb048efb6 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:08.968288 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fdb81611-5856-4a6a-a499-719bb048efb6 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:08.968911 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fdb81611-5856-4a6a-a499-719bb048efb6 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:09.120279 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-fdb81611-5856-4a6a-a499-719bb048efb6 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:09.127752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-fdb81611-5856-4a6a-a499-719bb048efb6 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.172313 May 16 20:39:09.138592 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 128/261] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:08 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:09.373606 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-109526c9-cba6-4ab7-a5f5-cf6014bb8262 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:09.374982 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-109526c9-cba6-4ab7-a5f5-cf6014bb8262 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:09.386234 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-109526c9-cba6-4ab7-a5f5-cf6014bb8262 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:09.387031 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-109526c9-cba6-4ab7-a5f5-cf6014bb8262 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:09.388238 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-109526c9-cba6-4ab7-a5f5-cf6014bb8262 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:09.388895 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-109526c9-cba6-4ab7-a5f5-cf6014bb8262 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:09.782834 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-fb4c1b6b-d736-44f3-a489-bf0c2dd4ca08 req-d17a67a4-6562-4604-a27f-51cb5cdfb1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36eca126-3242-483f-a941-432265ebaf50", "tag": "b91c820c-8c4e-4967-8610-a735537dcff4"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:39:09.815380 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-fb4c1b6b-d736-44f3-a489-bf0c2dd4ca08 req-d17a67a4-6562-4604-a27f-51cb5cdfb1d8 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:09.815829 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-fb4c1b6b-d736-44f3-a489-bf0c2dd4ca08 req-d17a67a4-6562-4604-a27f-51cb5cdfb1d8 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:09.835054 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-fb4c1b6b-d736-44f3-a489-bf0c2dd4ca08 req-d17a67a4-6562-4604-a27f-51cb5cdfb1d8 service nova] Creating event network-changed:b91c820c-8c4e-4967-8610-a735537dcff4 for instance 36eca126-3242-483f-a941-432265ebaf50 on hv-cinder-77703 May 16 20:39:09.841355 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-fb4c1b6b-d736-44f3-a489-bf0c2dd4ca08 req-d17a67a4-6562-4604-a27f-51cb5cdfb1d8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068449 May 16 20:39:09.845572 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 129/262] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:39:09.968000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-109526c9-cba6-4ab7-a5f5-cf6014bb8262 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:09.981463 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-109526c9-cba6-4ab7-a5f5-cf6014bb8262 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:09.990983 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-109526c9-cba6-4ab7-a5f5-cf6014bb8262 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:10.007109 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-109526c9-cba6-4ab7-a5f5-cf6014bb8262 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1739 microversion: 2.20 time: 0.624165 May 16 20:39:10.023298 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 134/263] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:09 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1739 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:10.146413 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-3e9c57fc-cc95-4eac-82a7-cc2b485afb6d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:10.147141 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-3e9c57fc-cc95-4eac-82a7-cc2b485afb6d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:10.157580 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3e9c57fc-cc95-4eac-82a7-cc2b485afb6d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:10.161147 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3e9c57fc-cc95-4eac-82a7-cc2b485afb6d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:10.162034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3e9c57fc-cc95-4eac-82a7-cc2b485afb6d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:10.162479 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3e9c57fc-cc95-4eac-82a7-cc2b485afb6d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:10.736004 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-3e9c57fc-cc95-4eac-82a7-cc2b485afb6d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:10.747796 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-3e9c57fc-cc95-4eac-82a7-cc2b485afb6d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.603843 May 16 20:39:10.748426 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 130/264] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:10 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:11.035415 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-d24f3039-9f7f-41cd-ba9e-ecf184a74c91 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:11.035415 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-d24f3039-9f7f-41cd-ba9e-ecf184a74c91 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:11.042164 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d24f3039-9f7f-41cd-ba9e-ecf184a74c91 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:11.042627 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d24f3039-9f7f-41cd-ba9e-ecf184a74c91 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:11.055048 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d24f3039-9f7f-41cd-ba9e-ecf184a74c91 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:11.055741 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d24f3039-9f7f-41cd-ba9e-ecf184a74c91 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:11.470106 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-d24f3039-9f7f-41cd-ba9e-ecf184a74c91 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:11.479225 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-d24f3039-9f7f-41cd-ba9e-ecf184a74c91 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:11.490912 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-d24f3039-9f7f-41cd-ba9e-ecf184a74c91 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:11.492214 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-d24f3039-9f7f-41cd-ba9e-ecf184a74c91 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1739 microversion: 2.20 time: 0.468206 May 16 20:39:11.496352 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 135/265] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:11 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1739 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:11.768024 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0034a3d8-4443-4440-99d7-4d4c6bf719b5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:11.769760 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0034a3d8-4443-4440-99d7-4d4c6bf719b5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:11.815626 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0034a3d8-4443-4440-99d7-4d4c6bf719b5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:11.816094 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0034a3d8-4443-4440-99d7-4d4c6bf719b5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:11.822754 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0034a3d8-4443-4440-99d7-4d4c6bf719b5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:11.823254 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0034a3d8-4443-4440-99d7-4d4c6bf719b5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:12.262802 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-0034a3d8-4443-4440-99d7-4d4c6bf719b5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:12.275544 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0034a3d8-4443-4440-99d7-4d4c6bf719b5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.513454 May 16 20:39:12.289107 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 131/266] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:11 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:12.513992 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-b7390f7a-dd3c-43ae-845c-4cbb1c25342e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:12.515570 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-b7390f7a-dd3c-43ae-845c-4cbb1c25342e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:12.535063 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b7390f7a-dd3c-43ae-845c-4cbb1c25342e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:12.536389 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b7390f7a-dd3c-43ae-845c-4cbb1c25342e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:12.537595 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b7390f7a-dd3c-43ae-845c-4cbb1c25342e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:12.538391 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b7390f7a-dd3c-43ae-845c-4cbb1c25342e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:13.011076 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-b7390f7a-dd3c-43ae-845c-4cbb1c25342e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:13.043536 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-b7390f7a-dd3c-43ae-845c-4cbb1c25342e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:13.046319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-b7390f7a-dd3c-43ae-845c-4cbb1c25342e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:13.047978 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-b7390f7a-dd3c-43ae-845c-4cbb1c25342e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1739 microversion: 2.20 time: 0.538081 May 16 20:39:13.063397 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 136/267] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:12 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1739 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:13.296052 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-b040cd89-e670-45c6-a260-dc46326c194a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:13.299861 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-b040cd89-e670-45c6-a260-dc46326c194a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:13.310550 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b040cd89-e670-45c6-a260-dc46326c194a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:13.315254 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b040cd89-e670-45c6-a260-dc46326c194a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:13.315254 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b040cd89-e670-45c6-a260-dc46326c194a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:13.315254 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b040cd89-e670-45c6-a260-dc46326c194a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:13.560856 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-b040cd89-e670-45c6-a260-dc46326c194a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:13.577640 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-b040cd89-e670-45c6-a260-dc46326c194a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.287838 May 16 20:39:13.588763 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 132/268] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:13 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:14.067311 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-69e537e6-7ba0-4321-aec8-b1cd8e1eac73 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:14.068790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-69e537e6-7ba0-4321-aec8-b1cd8e1eac73 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:14.077933 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-69e537e6-7ba0-4321-aec8-b1cd8e1eac73 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:14.079713 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-69e537e6-7ba0-4321-aec8-b1cd8e1eac73 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:14.085178 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-69e537e6-7ba0-4321-aec8-b1cd8e1eac73 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:14.085991 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-69e537e6-7ba0-4321-aec8-b1cd8e1eac73 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:14.595019 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2ebd2d93-87f3-4b11-b59d-8153c0b5166e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:14.595603 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-2ebd2d93-87f3-4b11-b59d-8153c0b5166e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:14.604319 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2ebd2d93-87f3-4b11-b59d-8153c0b5166e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:14.608900 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2ebd2d93-87f3-4b11-b59d-8153c0b5166e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:14.609971 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2ebd2d93-87f3-4b11-b59d-8153c0b5166e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:14.610591 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2ebd2d93-87f3-4b11-b59d-8153c0b5166e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:14.979420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-69e537e6-7ba0-4321-aec8-b1cd8e1eac73 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:14.988252 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-69e537e6-7ba0-4321-aec8-b1cd8e1eac73 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:14.998246 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-69e537e6-7ba0-4321-aec8-b1cd8e1eac73 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:14.999484 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-69e537e6-7ba0-4321-aec8-b1cd8e1eac73 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1739 microversion: 2.20 time: 0.936185 May 16 20:39:15.000237 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 137/269] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:14 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1739 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:15.087999 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-2ebd2d93-87f3-4b11-b59d-8153c0b5166e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:15.101501 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-2ebd2d93-87f3-4b11-b59d-8153c0b5166e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.510033 May 16 20:39:15.103678 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 133/270] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:14 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:39:16.020940 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-931a85df-fa55-4ccf-a9eb-9f38f45423c3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:16.021842 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-931a85df-fa55-4ccf-a9eb-9f38f45423c3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:16.032275 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-931a85df-fa55-4ccf-a9eb-9f38f45423c3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:16.036710 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-931a85df-fa55-4ccf-a9eb-9f38f45423c3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:16.037914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-931a85df-fa55-4ccf-a9eb-9f38f45423c3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:16.038526 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-931a85df-fa55-4ccf-a9eb-9f38f45423c3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:16.133161 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-c9dd66ab-61ed-4fa3-adcf-72e14c1d5057 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:16.135885 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-c9dd66ab-61ed-4fa3-adcf-72e14c1d5057 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:16.152335 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c9dd66ab-61ed-4fa3-adcf-72e14c1d5057 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:16.153078 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c9dd66ab-61ed-4fa3-adcf-72e14c1d5057 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:16.153967 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c9dd66ab-61ed-4fa3-adcf-72e14c1d5057 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:16.154641 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c9dd66ab-61ed-4fa3-adcf-72e14c1d5057 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:16.535331 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-c9dd66ab-61ed-4fa3-adcf-72e14c1d5057 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:16.557335 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-c9dd66ab-61ed-4fa3-adcf-72e14c1d5057 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.440500 May 16 20:39:16.559398 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 134/271] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:16 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:16.626816 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-931a85df-fa55-4ccf-a9eb-9f38f45423c3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:16.645884 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-931a85df-fa55-4ccf-a9eb-9f38f45423c3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:16.649863 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-931a85df-fa55-4ccf-a9eb-9f38f45423c3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:16.651618 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-931a85df-fa55-4ccf-a9eb-9f38f45423c3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1739 microversion: 2.20 time: 0.637803 May 16 20:39:16.652413 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 138/272] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:16 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1739 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:17.581918 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-c5ddc2bf-788f-4ac5-b4fd-eaed4ab52107 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:17.583085 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-c5ddc2bf-788f-4ac5-b4fd-eaed4ab52107 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:17.595194 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c5ddc2bf-788f-4ac5-b4fd-eaed4ab52107 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:17.600414 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c5ddc2bf-788f-4ac5-b4fd-eaed4ab52107 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:17.601286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c5ddc2bf-788f-4ac5-b4fd-eaed4ab52107 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:17.604120 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c5ddc2bf-788f-4ac5-b4fd-eaed4ab52107 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:17.670408 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-dcd7f90c-1bee-44fc-905e-dc09f69ffe52 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:17.671066 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-dcd7f90c-1bee-44fc-905e-dc09f69ffe52 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:17.686429 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dcd7f90c-1bee-44fc-905e-dc09f69ffe52 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:17.687947 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dcd7f90c-1bee-44fc-905e-dc09f69ffe52 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:17.689420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dcd7f90c-1bee-44fc-905e-dc09f69ffe52 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:17.690796 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dcd7f90c-1bee-44fc-905e-dc09f69ffe52 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:18.171403 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-c5ddc2bf-788f-4ac5-b4fd-eaed4ab52107 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:18.177085 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-dcd7f90c-1bee-44fc-905e-dc09f69ffe52 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:18.207456 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-c5ddc2bf-788f-4ac5-b4fd-eaed4ab52107 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1522 microversion: 2.1 time: 0.634892 May 16 20:39:18.214419 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 135/273] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:17 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1522 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:18.224291 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-dcd7f90c-1bee-44fc-905e-dc09f69ffe52 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:18.226138 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-dcd7f90c-1bee-44fc-905e-dc09f69ffe52 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:18.229636 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-dcd7f90c-1bee-44fc-905e-dc09f69ffe52 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1721 microversion: 2.20 time: 0.563250 May 16 20:39:18.234306 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 139/274] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:17 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1721 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:19.235757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-f613c22b-8a1c-41fc-82c3-c77cd29d9d80 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:19.236369 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-f613c22b-8a1c-41fc-82c3-c77cd29d9d80 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:19.245645 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f613c22b-8a1c-41fc-82c3-c77cd29d9d80 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:19.246095 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f613c22b-8a1c-41fc-82c3-c77cd29d9d80 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:19.251176 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-fd1ccb86-c04f-4977-902e-991c6066ce4c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:19.251789 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-fd1ccb86-c04f-4977-902e-991c6066ce4c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:19.266552 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-fd1ccb86-c04f-4977-902e-991c6066ce4c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:19.272294 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f613c22b-8a1c-41fc-82c3-c77cd29d9d80 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:19.273353 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-fd1ccb86-c04f-4977-902e-991c6066ce4c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:19.274812 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-fd1ccb86-c04f-4977-902e-991c6066ce4c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:19.275507 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f613c22b-8a1c-41fc-82c3-c77cd29d9d80 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:19.277202 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-fd1ccb86-c04f-4977-902e-991c6066ce4c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:19.712894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-fd1ccb86-c04f-4977-902e-991c6066ce4c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:19.731721 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-fd1ccb86-c04f-4977-902e-991c6066ce4c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:19.736364 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-fd1ccb86-c04f-4977-902e-991c6066ce4c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:19.741544 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-fd1ccb86-c04f-4977-902e-991c6066ce4c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1721 microversion: 2.20 time: 0.493077 May 16 20:39:19.746670 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 140/275] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:19 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1721 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:39:19.764713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f613c22b-8a1c-41fc-82c3-c77cd29d9d80 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:19.773608 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-f613c22b-8a1c-41fc-82c3-c77cd29d9d80 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1502 microversion: 2.1 time: 0.542310 May 16 20:39:19.780316 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-2aef3d67-afad-40c2-b64c-4c7b1283a5c1 req-74a6dca8-81ec-43b6-bef2-7e597e3ad366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8d450f-828f-4002-b649-ff13d14a047c", "name": "network-vif-unplugged", "status": "completed", "tag": "6aa491fa-5223-4d44-b9ca-f8811045b0ad"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:39:19.787267 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 136/276] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:19 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1502 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:19.828189 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-20898472-9d35-4d59-8c31-f4b6de3d0389 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:19.831467 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-20898472-9d35-4d59-8c31-f4b6de3d0389 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:19.835309 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-2aef3d67-afad-40c2-b64c-4c7b1283a5c1 req-74a6dca8-81ec-43b6-bef2-7e597e3ad366 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:19.836039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-2aef3d67-afad-40c2-b64c-4c7b1283a5c1 req-74a6dca8-81ec-43b6-bef2-7e597e3ad366 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:19.864472 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-20898472-9d35-4d59-8c31-f4b6de3d0389 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:19.865896 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-20898472-9d35-4d59-8c31-f4b6de3d0389 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:19.872077 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-20898472-9d35-4d59-8c31-f4b6de3d0389 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:19.875084 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-20898472-9d35-4d59-8c31-f4b6de3d0389 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:19.891900 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-2aef3d67-afad-40c2-b64c-4c7b1283a5c1 req-74a6dca8-81ec-43b6-bef2-7e597e3ad366 service nova] Creating event network-vif-unplugged:6aa491fa-5223-4d44-b9ca-f8811045b0ad for instance 6f8d450f-828f-4002-b649-ff13d14a047c on hv-cinder-77703 May 16 20:39:19.908049 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-2aef3d67-afad-40c2-b64c-4c7b1283a5c1 req-74a6dca8-81ec-43b6-bef2-7e597e3ad366 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.153194 May 16 20:39:19.909399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 141/277] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:39:20.474606 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-20898472-9d35-4d59-8c31-f4b6de3d0389 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:20.497055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-20898472-9d35-4d59-8c31-f4b6de3d0389 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1515 microversion: 2.1 time: 0.676718 May 16 20:39:20.503342 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 137/278] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:19 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1515 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:20.765432 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-c9be0271-52f2-4ebb-b173-ee5e15aec94d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:20.766131 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-c9be0271-52f2-4ebb-b173-ee5e15aec94d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:20.789457 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c9be0271-52f2-4ebb-b173-ee5e15aec94d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:20.795988 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c9be0271-52f2-4ebb-b173-ee5e15aec94d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:20.797162 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c9be0271-52f2-4ebb-b173-ee5e15aec94d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:20.805240 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c9be0271-52f2-4ebb-b173-ee5e15aec94d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:21.154547 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-c9be0271-52f2-4ebb-b173-ee5e15aec94d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:21.174304 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-c9be0271-52f2-4ebb-b173-ee5e15aec94d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:21.179720 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-c9be0271-52f2-4ebb-b173-ee5e15aec94d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:21.181032 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-c9be0271-52f2-4ebb-b173-ee5e15aec94d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1724 microversion: 2.20 time: 0.419845 May 16 20:39:21.189284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 142/279] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:20 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1724 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:21.212721 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-01b27b3c-061c-4d43-b873-2aba0d1fb3d0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "105a7c94-734c-44e3-86c2-d95b74e9e364"}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:39:21.213868 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-01b27b3c-061c-4d43-b873-2aba0d1fb3d0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:21.232635 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-01b27b3c-061c-4d43-b873-2aba0d1fb3d0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:21.233276 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-01b27b3c-061c-4d43-b873-2aba0d1fb3d0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:21.234116 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-01b27b3c-061c-4d43-b873-2aba0d1fb3d0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:21.234552 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-01b27b3c-061c-4d43-b873-2aba0d1fb3d0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:21.902648 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-01b27b3c-061c-4d43-b873-2aba0d1fb3d0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "POST /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.696389 May 16 20:39:21.908111 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 138/280] 10.222.0.49 () {62 vars in 1363 bytes} [Mon May 16 20:39:21 2022] POST /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c/os-volume_attachments => generated 188 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 20:39:22.191445 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-602d58ba-0747-4602-9ab6-23829c2dcb07 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:39:22.192557 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-602d58ba-0747-4602-9ab6-23829c2dcb07 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:22.212108 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-602d58ba-0747-4602-9ab6-23829c2dcb07 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:22.212897 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-602d58ba-0747-4602-9ab6-23829c2dcb07 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:22.213681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-602d58ba-0747-4602-9ab6-23829c2dcb07 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:22.215270 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-602d58ba-0747-4602-9ab6-23829c2dcb07 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:22.433608 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2fc9f919-aa29-4568-bd32-3d804208c419 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:39:22.434645 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-2fc9f919-aa29-4568-bd32-3d804208c419 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:22.445310 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-602d58ba-0747-4602-9ab6-23829c2dcb07 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "POST /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c/action" status: 202 len: 0 microversion: 2.20 time: 0.257768 May 16 20:39:22.450455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 143/281] 10.222.0.49 () {62 vars in 1318 bytes} [Mon May 16 20:39:22 2022] POST /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 20:39:22.453571 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2fc9f919-aa29-4568-bd32-3d804208c419 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:22.459970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2fc9f919-aa29-4568-bd32-3d804208c419 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:22.461897 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2fc9f919-aa29-4568-bd32-3d804208c419 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:22.464876 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2fc9f919-aa29-4568-bd32-3d804208c419 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:22.468481 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a558d085-7e39-4e37-b3bf-ba54f6b2911a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:22.470151 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-a558d085-7e39-4e37-b3bf-ba54f6b2911a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:22.478548 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a558d085-7e39-4e37-b3bf-ba54f6b2911a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:22.479255 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a558d085-7e39-4e37-b3bf-ba54f6b2911a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:22.480952 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a558d085-7e39-4e37-b3bf-ba54f6b2911a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:22.481729 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a558d085-7e39-4e37-b3bf-ba54f6b2911a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:22.524127 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.objects.instance [None req-2fc9f919-aa29-4568-bd32-3d804208c419 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lazy-loading 'flavor' on Instance uuid d02eea51-3d7f-45e0-83ee-349ebd8121f8 {{(pid=123563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:39:22.683811 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a558d085-7e39-4e37-b3bf-ba54f6b2911a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:22.696912 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-2fc9f919-aa29-4568-bd32-3d804208c419 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "POST /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8/action" status: 200 len: 32 microversion: 2.1 time: 0.271972 May 16 20:39:22.701956 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 139/282] 10.222.0.49 () {60 vars in 1277 bytes} [Mon May 16 20:39:22 2022] POST /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8/action => generated 32 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 20:39:22.709351 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a558d085-7e39-4e37-b3bf-ba54f6b2911a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:22.710191 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-f57ffa4b-2c34-48cd-93f0-ca4e8a92b09f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:22.711051 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-f57ffa4b-2c34-48cd-93f0-ca4e8a92b09f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:22.711344 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a558d085-7e39-4e37-b3bf-ba54f6b2911a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:22.714961 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-a558d085-7e39-4e37-b3bf-ba54f6b2911a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1750 microversion: 2.20 time: 0.262576 May 16 20:39:22.715580 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 144/283] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:22 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1750 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:22.719074 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f57ffa4b-2c34-48cd-93f0-ca4e8a92b09f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:22.719518 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f57ffa4b-2c34-48cd-93f0-ca4e8a92b09f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:22.720503 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f57ffa4b-2c34-48cd-93f0-ca4e8a92b09f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:22.721072 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f57ffa4b-2c34-48cd-93f0-ca4e8a92b09f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:22.948125 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f57ffa4b-2c34-48cd-93f0-ca4e8a92b09f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:22.963157 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-f57ffa4b-2c34-48cd-93f0-ca4e8a92b09f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1521 microversion: 2.1 time: 0.258658 May 16 20:39:22.975391 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 140/284] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:22 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:23.733832 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-d137a615-0dbb-4a4e-b5f4-5d92fb2889f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:23.735118 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-d137a615-0dbb-4a4e-b5f4-5d92fb2889f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:23.758113 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d137a615-0dbb-4a4e-b5f4-5d92fb2889f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:23.760185 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d137a615-0dbb-4a4e-b5f4-5d92fb2889f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:23.763341 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d137a615-0dbb-4a4e-b5f4-5d92fb2889f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:23.764013 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d137a615-0dbb-4a4e-b5f4-5d92fb2889f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:23.983572 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-b56708cd-809d-420a-85d6-cd6fb4a035dd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:23.984189 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-b56708cd-809d-420a-85d6-cd6fb4a035dd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:24.024513 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b56708cd-809d-420a-85d6-cd6fb4a035dd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:24.025210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b56708cd-809d-420a-85d6-cd6fb4a035dd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:24.038215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b56708cd-809d-420a-85d6-cd6fb4a035dd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:24.051764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b56708cd-809d-420a-85d6-cd6fb4a035dd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:24.311465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-d137a615-0dbb-4a4e-b5f4-5d92fb2889f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:24.325046 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-d137a615-0dbb-4a4e-b5f4-5d92fb2889f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:24.327214 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-d137a615-0dbb-4a4e-b5f4-5d92fb2889f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:24.330304 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-d137a615-0dbb-4a4e-b5f4-5d92fb2889f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1750 microversion: 2.20 time: 0.600703 May 16 20:39:24.346949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 145/285] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:23 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1750 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:24.465762 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-b56708cd-809d-420a-85d6-cd6fb4a035dd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:24.479701 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-b56708cd-809d-420a-85d6-cd6fb4a035dd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1521 microversion: 2.1 time: 0.496659 May 16 20:39:24.496582 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 141/286] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:23 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1521 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:25.351214 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6cf3fe86-1227-4270-89a4-831145215450 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:25.352677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-6cf3fe86-1227-4270-89a4-831145215450 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:25.361198 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6cf3fe86-1227-4270-89a4-831145215450 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:25.362273 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6cf3fe86-1227-4270-89a4-831145215450 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:25.363549 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6cf3fe86-1227-4270-89a4-831145215450 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:25.364169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6cf3fe86-1227-4270-89a4-831145215450 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:25.498377 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0a048d33-1a51-49d2-bf86-da59930783b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:25.499006 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0a048d33-1a51-49d2-bf86-da59930783b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:25.512888 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0a048d33-1a51-49d2-bf86-da59930783b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:25.513361 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0a048d33-1a51-49d2-bf86-da59930783b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:25.514163 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0a048d33-1a51-49d2-bf86-da59930783b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:25.514593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0a048d33-1a51-49d2-bf86-da59930783b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:25.974251 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-0a048d33-1a51-49d2-bf86-da59930783b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:25.987605 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0a048d33-1a51-49d2-bf86-da59930783b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1521 microversion: 2.1 time: 0.494044 May 16 20:39:25.997084 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 142/287] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:25 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1521 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:39:26.092176 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6cf3fe86-1227-4270-89a4-831145215450 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:26.107747 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6cf3fe86-1227-4270-89a4-831145215450 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:26.110953 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6cf3fe86-1227-4270-89a4-831145215450 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:26.114311 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-6cf3fe86-1227-4270-89a4-831145215450 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1752 microversion: 2.20 time: 0.768965 May 16 20:39:26.118746 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 146/288] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:25 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1752 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:27.009273 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-27172549-8815-463b-8e56-22ba18e375bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:27.010957 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-27172549-8815-463b-8e56-22ba18e375bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:27.020074 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-27172549-8815-463b-8e56-22ba18e375bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:27.023335 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-27172549-8815-463b-8e56-22ba18e375bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:27.024381 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-27172549-8815-463b-8e56-22ba18e375bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:27.026495 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-27172549-8815-463b-8e56-22ba18e375bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:27.138601 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-66373c8f-9af9-4927-8c69-27f13b6f3f19 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:27.140073 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-66373c8f-9af9-4927-8c69-27f13b6f3f19 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:27.147118 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-66373c8f-9af9-4927-8c69-27f13b6f3f19 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:27.148065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-66373c8f-9af9-4927-8c69-27f13b6f3f19 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:27.149121 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-66373c8f-9af9-4927-8c69-27f13b6f3f19 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:27.149983 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-66373c8f-9af9-4927-8c69-27f13b6f3f19 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:27.677796 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-27172549-8815-463b-8e56-22ba18e375bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:27.692240 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-27172549-8815-463b-8e56-22ba18e375bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1521 microversion: 2.1 time: 0.688277 May 16 20:39:27.695678 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 143/289] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:26 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1521 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:27.708519 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-66373c8f-9af9-4927-8c69-27f13b6f3f19 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:27.717207 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-66373c8f-9af9-4927-8c69-27f13b6f3f19 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:27.718707 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-66373c8f-9af9-4927-8c69-27f13b6f3f19 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:27.719909 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-66373c8f-9af9-4927-8c69-27f13b6f3f19 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.586720 May 16 20:39:27.728551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 147/290] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:27 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:39:28.710518 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-31fea80c-88d5-48de-be69-81c25b625919 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:28.713233 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-31fea80c-88d5-48de-be69-81c25b625919 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:28.724428 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-31fea80c-88d5-48de-be69-81c25b625919 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:28.741527 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-089a4ccd-f485-48c0-928e-1e76ff670c46 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:28.742151 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-089a4ccd-f485-48c0-928e-1e76ff670c46 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:28.753059 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-31fea80c-88d5-48de-be69-81c25b625919 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:28.754182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-31fea80c-88d5-48de-be69-81c25b625919 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:28.754689 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-31fea80c-88d5-48de-be69-81c25b625919 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:28.757673 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-089a4ccd-f485-48c0-928e-1e76ff670c46 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:28.758121 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-089a4ccd-f485-48c0-928e-1e76ff670c46 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:28.759186 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-089a4ccd-f485-48c0-928e-1e76ff670c46 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:28.760001 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-089a4ccd-f485-48c0-928e-1e76ff670c46 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:29.579203 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-31fea80c-88d5-48de-be69-81c25b625919 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:29.591197 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-31fea80c-88d5-48de-be69-81c25b625919 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1521 microversion: 2.1 time: 0.884770 May 16 20:39:29.592913 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 144/291] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:28 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1521 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:29.611642 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-089a4ccd-f485-48c0-928e-1e76ff670c46 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:29.628280 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-089a4ccd-f485-48c0-928e-1e76ff670c46 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:29.631520 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-089a4ccd-f485-48c0-928e-1e76ff670c46 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:29.639971 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-089a4ccd-f485-48c0-928e-1e76ff670c46 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.902703 May 16 20:39:29.641207 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 148/292] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:28 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:39:30.642427 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-86ab3e87-c829-418a-bd93-aaa6ce66d107 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:30.643762 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-86ab3e87-c829-418a-bd93-aaa6ce66d107 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:30.663933 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-fe6e7404-f284-4102-98f8-7ada72abc06e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:30.668199 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-fe6e7404-f284-4102-98f8-7ada72abc06e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:30.678859 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-86ab3e87-c829-418a-bd93-aaa6ce66d107 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:30.679918 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-fe6e7404-f284-4102-98f8-7ada72abc06e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:30.684357 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-fe6e7404-f284-4102-98f8-7ada72abc06e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:30.685378 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-86ab3e87-c829-418a-bd93-aaa6ce66d107 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:30.686464 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-86ab3e87-c829-418a-bd93-aaa6ce66d107 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:30.687326 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-fe6e7404-f284-4102-98f8-7ada72abc06e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:30.687979 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-fe6e7404-f284-4102-98f8-7ada72abc06e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:30.691626 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-86ab3e87-c829-418a-bd93-aaa6ce66d107 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:31.168392 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-86ab3e87-c829-418a-bd93-aaa6ce66d107 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:31.181303 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-86ab3e87-c829-418a-bd93-aaa6ce66d107 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1521 microversion: 2.1 time: 0.540460 May 16 20:39:31.183282 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 145/293] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:30 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1521 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:31.309422 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-fe6e7404-f284-4102-98f8-7ada72abc06e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:31.328278 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-fe6e7404-f284-4102-98f8-7ada72abc06e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:31.331024 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-fe6e7404-f284-4102-98f8-7ada72abc06e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:31.332737 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-fe6e7404-f284-4102-98f8-7ada72abc06e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.672673 May 16 20:39:31.349715 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 149/294] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:30 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:32.199942 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-ea92d85d-ffdc-4d52-b6f4-696ba89c5bce tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:32.201482 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-ea92d85d-ffdc-4d52-b6f4-696ba89c5bce tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:32.239230 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ea92d85d-ffdc-4d52-b6f4-696ba89c5bce tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:32.243769 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ea92d85d-ffdc-4d52-b6f4-696ba89c5bce tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:32.245392 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ea92d85d-ffdc-4d52-b6f4-696ba89c5bce tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:32.249263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ea92d85d-ffdc-4d52-b6f4-696ba89c5bce tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:32.358216 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-5df94952-c7e7-46b0-9c2e-e928414262f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:32.359526 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-5df94952-c7e7-46b0-9c2e-e928414262f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:32.376965 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5df94952-c7e7-46b0-9c2e-e928414262f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:32.381205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5df94952-c7e7-46b0-9c2e-e928414262f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:32.382957 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5df94952-c7e7-46b0-9c2e-e928414262f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:32.383561 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5df94952-c7e7-46b0-9c2e-e928414262f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:32.867027 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-5df94952-c7e7-46b0-9c2e-e928414262f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:32.869816 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ea92d85d-ffdc-4d52-b6f4-696ba89c5bce tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:32.882667 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-5df94952-c7e7-46b0-9c2e-e928414262f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:32.884538 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-ea92d85d-ffdc-4d52-b6f4-696ba89c5bce tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1521 microversion: 2.1 time: 0.689035 May 16 20:39:32.885135 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 146/295] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:32 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1521 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:32.901144 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-5df94952-c7e7-46b0-9c2e-e928414262f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:32.905444 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-5df94952-c7e7-46b0-9c2e-e928414262f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.553889 May 16 20:39:32.912170 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 150/296] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:32 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:33.590829 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-b2d57993-27cc-4e55-937e-71ac71c1b1f5 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Action: 'create', calling method: .version_select at 0x7f81b1343af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1538528591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRD58pj3PsRm8WpKa7EDl7z6OtrvMxItBsUHAk9e28KoG5CK9KNeQ8LPPG9UthXzs92LlcWWng2H2Pp7tXJEE2DN1BBHgu6WnBadagaGALkPFIhoJILTXX2IaqMvgz+hg=="}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:39:33.624479 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-b2d57993-27cc-4e55-937e-71ac71c1b1f5 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Getting quotas for project 710ecde5160640149c693e0c2b0b0354. Resources: {'key_pairs'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:39:33.640971 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-b2d57993-27cc-4e55-937e-71ac71c1b1f5 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Getting quotas for user 6fa431ce09e44b85b61af972bbce2ed4 and project 710ecde5160640149c693e0c2b0b0354. Resources: {'key_pairs'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:39:33.700131 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-b2d57993-27cc-4e55-937e-71ac71c1b1f5 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.400895 May 16 20:39:33.701002 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 147/297] 10.222.0.49 () {60 vars in 1158 bytes} [Mon May 16 20:39:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:39:33.902381 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6bb81440-7b9f-4080-81be-6411d5f00fcf tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:33.903252 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-6bb81440-7b9f-4080-81be-6411d5f00fcf tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:33.918278 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6bb81440-7b9f-4080-81be-6411d5f00fcf tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:33.920161 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6bb81440-7b9f-4080-81be-6411d5f00fcf tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:33.921293 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6bb81440-7b9f-4080-81be-6411d5f00fcf tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:33.925711 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6bb81440-7b9f-4080-81be-6411d5f00fcf tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:33.941731 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-d1de4990-79f6-4424-a5e5-d6731b8c4c48 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:33.943528 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-d1de4990-79f6-4424-a5e5-d6731b8c4c48 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:33.962520 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d1de4990-79f6-4424-a5e5-d6731b8c4c48 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:33.964534 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d1de4990-79f6-4424-a5e5-d6731b8c4c48 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:33.967106 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d1de4990-79f6-4424-a5e5-d6731b8c4c48 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:33.969612 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d1de4990-79f6-4424-a5e5-d6731b8c4c48 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:34.429781 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6bb81440-7b9f-4080-81be-6411d5f00fcf tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:34.442365 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-6bb81440-7b9f-4080-81be-6411d5f00fcf tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1521 microversion: 2.1 time: 0.544269 May 16 20:39:34.442964 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 151/298] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:33 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:34.455606 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d1de4990-79f6-4424-a5e5-d6731b8c4c48 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:34.465306 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d1de4990-79f6-4424-a5e5-d6731b8c4c48 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:34.466736 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d1de4990-79f6-4424-a5e5-d6731b8c4c48 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:34.489964 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-d1de4990-79f6-4424-a5e5-d6731b8c4c48 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.542784 May 16 20:39:34.492483 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 148/299] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:33 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:39:35.459469 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-134c7c63-2432-48f6-9d1e-366c51eafa43 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:35.460163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-134c7c63-2432-48f6-9d1e-366c51eafa43 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:35.469432 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-134c7c63-2432-48f6-9d1e-366c51eafa43 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:35.469936 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-134c7c63-2432-48f6-9d1e-366c51eafa43 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:35.470712 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-134c7c63-2432-48f6-9d1e-366c51eafa43 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:35.471167 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-134c7c63-2432-48f6-9d1e-366c51eafa43 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:35.515230 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-86dfd8e3-6b4e-4957-9bfa-0b544438894a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:35.515915 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-86dfd8e3-6b4e-4957-9bfa-0b544438894a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:35.529263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-86dfd8e3-6b4e-4957-9bfa-0b544438894a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:35.529630 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-86dfd8e3-6b4e-4957-9bfa-0b544438894a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:35.530429 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-86dfd8e3-6b4e-4957-9bfa-0b544438894a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:35.530919 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-86dfd8e3-6b4e-4957-9bfa-0b544438894a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:35.950054 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-134c7c63-2432-48f6-9d1e-366c51eafa43 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:35.967783 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-86dfd8e3-6b4e-4957-9bfa-0b544438894a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:35.985102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-134c7c63-2432-48f6-9d1e-366c51eafa43 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1521 microversion: 2.1 time: 0.529287 May 16 20:39:35.985716 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 152/300] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:35 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1521 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:35.989756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-86dfd8e3-6b4e-4957-9bfa-0b544438894a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:35.991565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-86dfd8e3-6b4e-4957-9bfa-0b544438894a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:35.993004 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-86dfd8e3-6b4e-4957-9bfa-0b544438894a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.482716 May 16 20:39:35.993804 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 149/301] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:35 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:39:37.016698 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-1bd8e252-f335-4cbe-9f4e-6c34e838651d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:37.027026 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-1bd8e252-f335-4cbe-9f4e-6c34e838651d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:37.027300 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-370fca3f-07cf-4139-9b6e-50de160cd898 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:37.028010 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-370fca3f-07cf-4139-9b6e-50de160cd898 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:37.041586 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-370fca3f-07cf-4139-9b6e-50de160cd898 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:37.046961 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1bd8e252-f335-4cbe-9f4e-6c34e838651d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:37.048740 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1bd8e252-f335-4cbe-9f4e-6c34e838651d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:37.051336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1bd8e252-f335-4cbe-9f4e-6c34e838651d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:37.054674 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-370fca3f-07cf-4139-9b6e-50de160cd898 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:37.056026 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1bd8e252-f335-4cbe-9f4e-6c34e838651d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:37.057406 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-370fca3f-07cf-4139-9b6e-50de160cd898 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:37.063042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-370fca3f-07cf-4139-9b6e-50de160cd898 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:37.352243 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-370fca3f-07cf-4139-9b6e-50de160cd898 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:37.362557 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-370fca3f-07cf-4139-9b6e-50de160cd898 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1521 microversion: 2.1 time: 0.342536 May 16 20:39:37.364790 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 150/302] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:37 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:37.398007 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-1bd8e252-f335-4cbe-9f4e-6c34e838651d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:37.408940 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-1bd8e252-f335-4cbe-9f4e-6c34e838651d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:37.410720 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-1bd8e252-f335-4cbe-9f4e-6c34e838651d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:37.412395 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-1bd8e252-f335-4cbe-9f4e-6c34e838651d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.401694 May 16 20:39:37.413591 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 153/303] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:37 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:38.414213 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-4230f825-9805-4d80-922a-0233096ce0a5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:38.414867 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-4230f825-9805-4d80-922a-0233096ce0a5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:38.439123 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4230f825-9805-4d80-922a-0233096ce0a5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:38.439802 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4230f825-9805-4d80-922a-0233096ce0a5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:38.440694 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4230f825-9805-4d80-922a-0233096ce0a5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:38.441361 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4230f825-9805-4d80-922a-0233096ce0a5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:38.452945 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-0d51c71e-756c-4434-b12c-29a043dd5497 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:38.453565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-0d51c71e-756c-4434-b12c-29a043dd5497 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:38.462250 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0d51c71e-756c-4434-b12c-29a043dd5497 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:38.464284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0d51c71e-756c-4434-b12c-29a043dd5497 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:38.465354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0d51c71e-756c-4434-b12c-29a043dd5497 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:38.465791 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0d51c71e-756c-4434-b12c-29a043dd5497 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:38.810691 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-4230f825-9805-4d80-922a-0233096ce0a5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:38.819123 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-4230f825-9805-4d80-922a-0233096ce0a5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1521 microversion: 2.1 time: 0.410547 May 16 20:39:38.832520 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 151/304] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:38 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:38.837510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-0d51c71e-756c-4434-b12c-29a043dd5497 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:38.847276 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-0d51c71e-756c-4434-b12c-29a043dd5497 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:38.855346 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-0d51c71e-756c-4434-b12c-29a043dd5497 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:38.870036 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-0d51c71e-756c-4434-b12c-29a043dd5497 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.432433 May 16 20:39:38.871199 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 154/305] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:38 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:39.836287 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-d606379b-4ac4-4f76-87eb-3b3a73ec38bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:39.837926 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-d606379b-4ac4-4f76-87eb-3b3a73ec38bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:39.858674 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d606379b-4ac4-4f76-87eb-3b3a73ec38bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:39.859563 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d606379b-4ac4-4f76-87eb-3b3a73ec38bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:39.860563 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d606379b-4ac4-4f76-87eb-3b3a73ec38bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:39.861155 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d606379b-4ac4-4f76-87eb-3b3a73ec38bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:39.889668 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-dcf4eb24-e88e-4286-b3e3-6f2fc6222cb8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:39.890984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-dcf4eb24-e88e-4286-b3e3-6f2fc6222cb8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:39.905726 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dcf4eb24-e88e-4286-b3e3-6f2fc6222cb8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:39.906189 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dcf4eb24-e88e-4286-b3e3-6f2fc6222cb8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:39.907018 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dcf4eb24-e88e-4286-b3e3-6f2fc6222cb8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:39.907448 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dcf4eb24-e88e-4286-b3e3-6f2fc6222cb8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:40.134240 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d606379b-4ac4-4f76-87eb-3b3a73ec38bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:40.142736 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-d606379b-4ac4-4f76-87eb-3b3a73ec38bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1521 microversion: 2.1 time: 0.311176 May 16 20:39:40.155122 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 152/306] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:39 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:40.191838 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-dcf4eb24-e88e-4286-b3e3-6f2fc6222cb8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:40.206287 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-dcf4eb24-e88e-4286-b3e3-6f2fc6222cb8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:40.208198 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-dcf4eb24-e88e-4286-b3e3-6f2fc6222cb8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:40.219468 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-dcf4eb24-e88e-4286-b3e3-6f2fc6222cb8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.328954 May 16 20:39:40.230540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 155/307] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:39 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:41.162068 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-c8c71c07-8b87-4962-85ac-8cba9e780af4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:41.163393 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-c8c71c07-8b87-4962-85ac-8cba9e780af4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:41.173254 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c8c71c07-8b87-4962-85ac-8cba9e780af4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:41.177240 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c8c71c07-8b87-4962-85ac-8cba9e780af4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:41.179124 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c8c71c07-8b87-4962-85ac-8cba9e780af4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:41.181421 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c8c71c07-8b87-4962-85ac-8cba9e780af4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:41.238085 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-2debef55-0bfd-474d-822b-2fc440a1a630 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:41.239527 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-2debef55-0bfd-474d-822b-2fc440a1a630 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:41.247778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2debef55-0bfd-474d-822b-2fc440a1a630 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:41.254998 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2debef55-0bfd-474d-822b-2fc440a1a630 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:41.260404 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2debef55-0bfd-474d-822b-2fc440a1a630 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:41.261787 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2debef55-0bfd-474d-822b-2fc440a1a630 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:41.615754 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-c8c71c07-8b87-4962-85ac-8cba9e780af4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:41.630042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-c8c71c07-8b87-4962-85ac-8cba9e780af4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1521 microversion: 2.1 time: 0.472224 May 16 20:39:41.632915 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 153/308] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:41 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:41.638270 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2debef55-0bfd-474d-822b-2fc440a1a630 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:41.650118 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2debef55-0bfd-474d-822b-2fc440a1a630 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:41.653900 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2debef55-0bfd-474d-822b-2fc440a1a630 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:41.655471 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-2debef55-0bfd-474d-822b-2fc440a1a630 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.421316 May 16 20:39:41.668185 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 156/309] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:41 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:42.649209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-cc784e38-a0f4-430e-be55-344c92643c16 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:42.649927 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-cc784e38-a0f4-430e-be55-344c92643c16 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:42.661866 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cc784e38-a0f4-430e-be55-344c92643c16 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:42.662377 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cc784e38-a0f4-430e-be55-344c92643c16 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:42.663220 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cc784e38-a0f4-430e-be55-344c92643c16 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:42.663669 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cc784e38-a0f4-430e-be55-344c92643c16 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:42.674631 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-f2c72273-81c2-4b98-b36f-e6b6a776d665 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:42.683692 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-f2c72273-81c2-4b98-b36f-e6b6a776d665 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:42.699220 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f2c72273-81c2-4b98-b36f-e6b6a776d665 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:42.699675 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f2c72273-81c2-4b98-b36f-e6b6a776d665 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:42.700493 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f2c72273-81c2-4b98-b36f-e6b6a776d665 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:42.700919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f2c72273-81c2-4b98-b36f-e6b6a776d665 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:42.949790 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-cc784e38-a0f4-430e-be55-344c92643c16 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:42.957399 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-cc784e38-a0f4-430e-be55-344c92643c16 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1521 microversion: 2.1 time: 0.311987 May 16 20:39:42.970229 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 154/310] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:42 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:42.981129 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-f2c72273-81c2-4b98-b36f-e6b6a776d665 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:42.993149 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-f2c72273-81c2-4b98-b36f-e6b6a776d665 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:42.995341 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-f2c72273-81c2-4b98-b36f-e6b6a776d665 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:42.997284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-f2c72273-81c2-4b98-b36f-e6b6a776d665 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.326312 May 16 20:39:42.998241 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 157/311] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:42 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:43.257836 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-42c6cb2d-4c82-4e41-95ad-9fcc8710b88b tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Action: 'create', calling method: .version_select at 0x7f81b1292040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-617396179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPuEs8FBBF5CyYEI8jIFIVrNXmOlUtSjqDqeIur8dQvMjKPN6A12DLHT71GEWOCVMDNgsFsjzJ/3Geg7Dxx+UK0KXoz6nU5IBQ6MgRE1sP8jcgcv7zFPNlQKMJ6E3FGsQ=="}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:39:43.270996 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-42c6cb2d-4c82-4e41-95ad-9fcc8710b88b tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Getting quotas for project 1260ab72bfde4bc9b3ba657ea0c18f14. Resources: {'key_pairs'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:39:43.275204 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-42c6cb2d-4c82-4e41-95ad-9fcc8710b88b tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Getting quotas for user e173bf0464c84f61b0b8f8ec071b61a9 and project 1260ab72bfde4bc9b3ba657ea0c18f14. Resources: {'key_pairs'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:39:43.297793 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-42c6cb2d-4c82-4e41-95ad-9fcc8710b88b tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.043809 May 16 20:39:43.298376 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 155/312] 10.222.0.49 () {60 vars in 1158 bytes} [Mon May 16 20:39:43 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:39:43.393127 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-9fd800d4-2b06-41ce-95de-138b2e4023e4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-816634006", "imageRef": "ce87c7a7-fb1b-4c32-9a41-334aebdc64d7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-617396179", "networks": [{"uuid": "575cc251-3783-4edf-8147-f5cd78cc82ea"}]}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:39:43.442742 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.network.neutron [None req-9fd800d4-2b06-41ce-95de-138b2e4023e4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] validate_networks() for [('575cc251-3783-4edf-8147-f5cd78cc82ea', None, None, None, None, None)] {{(pid=123564) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:39:43.822119 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-9fd800d4-2b06-41ce-95de-138b2e4023e4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Flavor limits 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:39:43.822723 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-9fd800d4-2b06-41ce-95de-138b2e4023e4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Image limits 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:39:43.823002 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-9fd800d4-2b06-41ce-95de-138b2e4023e4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Flavor pref 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:39:43.823408 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-9fd800d4-2b06-41ce-95de-138b2e4023e4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Image pref 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:39:43.823817 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-9fd800d4-2b06-41ce-95de-138b2e4023e4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:39:43.833201 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9fd800d4-2b06-41ce-95de-138b2e4023e4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:43.833651 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9fd800d4-2b06-41ce-95de-138b2e4023e4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:43.834626 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9fd800d4-2b06-41ce-95de-138b2e4023e4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:43.835070 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9fd800d4-2b06-41ce-95de-138b2e4023e4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:43.851737 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-9fd800d4-2b06-41ce-95de-138b2e4023e4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Getting quotas for project 1260ab72bfde4bc9b3ba657ea0c18f14. Resources: {'cores', 'ram', 'instances'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:39:43.856172 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-9fd800d4-2b06-41ce-95de-138b2e4023e4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Getting quotas for user e173bf0464c84f61b0b8f8ec071b61a9 and project 1260ab72bfde4bc9b3ba657ea0c18f14. Resources: {'cores', 'ram', 'instances'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:39:43.869655 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-9fd800d4-2b06-41ce-95de-138b2e4023e4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Going to run 1 instances... {{(pid=123564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:39:43.872387 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-9fd800d4-2b06-41ce-95de-138b2e4023e4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce87c7a7-fb1b-4c32-9a41-334aebdc64d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:39:43.930149 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-9fd800d4-2b06-41ce-95de-138b2e4023e4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540650 May 16 20:39:43.930834 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 158/313] 10.222.0.49 () {60 vars in 1146 bytes} [Mon May 16 20:39:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 20:39:43.941595 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0cc60dd8-e594-4b34-ac33-6fa92a3068d5 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:43.942241 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0cc60dd8-e594-4b34-ac33-6fa92a3068d5 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:43.980319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-965b6fdc-8571-45bf-847f-8a994a9c82a5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:43.982123 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-965b6fdc-8571-45bf-847f-8a994a9c82a5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:43.995781 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-965b6fdc-8571-45bf-847f-8a994a9c82a5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:43.996677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-965b6fdc-8571-45bf-847f-8a994a9c82a5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:43.998073 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-965b6fdc-8571-45bf-847f-8a994a9c82a5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:43.998847 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-965b6fdc-8571-45bf-847f-8a994a9c82a5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:44.013425 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-0cc60dd8-e594-4b34-ac33-6fa92a3068d5 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:44.020765 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0cc60dd8-e594-4b34-ac33-6fa92a3068d5 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1257 microversion: 2.1 time: 0.083502 May 16 20:39:44.021291 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 156/314] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:43 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1257 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:44.027155 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-ec9fa2ea-560b-4d8c-ac6a-b7532588adab tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:44.027755 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-ec9fa2ea-560b-4d8c-ac6a-b7532588adab tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:44.036267 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ec9fa2ea-560b-4d8c-ac6a-b7532588adab tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:44.036752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ec9fa2ea-560b-4d8c-ac6a-b7532588adab tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:44.037582 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ec9fa2ea-560b-4d8c-ac6a-b7532588adab tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:44.038031 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ec9fa2ea-560b-4d8c-ac6a-b7532588adab tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:44.223168 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-965b6fdc-8571-45bf-847f-8a994a9c82a5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:44.232532 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ec9fa2ea-560b-4d8c-ac6a-b7532588adab tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:44.236495 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-965b6fdc-8571-45bf-847f-8a994a9c82a5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1521 microversion: 2.1 time: 0.264578 May 16 20:39:44.237661 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 159/315] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:43 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:44.243619 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ec9fa2ea-560b-4d8c-ac6a-b7532588adab tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:44.245147 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ec9fa2ea-560b-4d8c-ac6a-b7532588adab tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:44.246441 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-ec9fa2ea-560b-4d8c-ac6a-b7532588adab tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.223987 May 16 20:39:44.246992 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 157/316] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:44 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:45.039334 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-94a2a413-47b8-41d0-a0f0-9f93e38cbb76 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:45.040121 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-94a2a413-47b8-41d0-a0f0-9f93e38cbb76 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:45.046904 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-94a2a413-47b8-41d0-a0f0-9f93e38cbb76 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:45.047350 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-94a2a413-47b8-41d0-a0f0-9f93e38cbb76 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:45.048128 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-94a2a413-47b8-41d0-a0f0-9f93e38cbb76 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:45.048605 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-94a2a413-47b8-41d0-a0f0-9f93e38cbb76 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:45.112133 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-94a2a413-47b8-41d0-a0f0-9f93e38cbb76 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:45.119903 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-94a2a413-47b8-41d0-a0f0-9f93e38cbb76 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1309 microversion: 2.1 time: 0.085216 May 16 20:39:45.120498 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 160/317] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:45 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1309 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:45.256707 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-9ed45d43-cbd5-4db3-a2ba-277365bfd900 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:45.257447 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-9ed45d43-cbd5-4db3-a2ba-277365bfd900 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:45.266926 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9ed45d43-cbd5-4db3-a2ba-277365bfd900 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:45.267208 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-f2356b33-71d2-41d5-b687-58cc61499694 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:45.267534 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9ed45d43-cbd5-4db3-a2ba-277365bfd900 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:45.267957 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-f2356b33-71d2-41d5-b687-58cc61499694 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:45.268703 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9ed45d43-cbd5-4db3-a2ba-277365bfd900 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:45.269317 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9ed45d43-cbd5-4db3-a2ba-277365bfd900 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:45.275987 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f2356b33-71d2-41d5-b687-58cc61499694 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:45.276606 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f2356b33-71d2-41d5-b687-58cc61499694 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:45.277346 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f2356b33-71d2-41d5-b687-58cc61499694 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:45.277773 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f2356b33-71d2-41d5-b687-58cc61499694 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:45.459607 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-9ed45d43-cbd5-4db3-a2ba-277365bfd900 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:45.468069 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-9ed45d43-cbd5-4db3-a2ba-277365bfd900 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1521 microversion: 2.1 time: 0.216996 May 16 20:39:45.468719 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 158/318] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:45 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:45.470336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-f2356b33-71d2-41d5-b687-58cc61499694 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:45.479447 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-f2356b33-71d2-41d5-b687-58cc61499694 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:45.480986 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-f2356b33-71d2-41d5-b687-58cc61499694 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:45.482192 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-f2356b33-71d2-41d5-b687-58cc61499694 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.220557 May 16 20:39:45.482735 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 161/319] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:45 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:46.136657 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-8c0b867a-708f-444d-8b54-ee1ab7db052d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:46.137371 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-8c0b867a-708f-444d-8b54-ee1ab7db052d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:46.143724 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8c0b867a-708f-444d-8b54-ee1ab7db052d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:46.144221 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8c0b867a-708f-444d-8b54-ee1ab7db052d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:46.145229 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8c0b867a-708f-444d-8b54-ee1ab7db052d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:46.145815 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8c0b867a-708f-444d-8b54-ee1ab7db052d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:46.215314 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-8c0b867a-708f-444d-8b54-ee1ab7db052d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:46.226156 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-8c0b867a-708f-444d-8b54-ee1ab7db052d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1315 microversion: 2.1 time: 0.093443 May 16 20:39:46.226786 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 159/320] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:46 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1315 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:46.485269 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-b0e8a72a-ea3f-45d9-b802-7a8df750145b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:46.485996 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-b0e8a72a-ea3f-45d9-b802-7a8df750145b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:46.493179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b0e8a72a-ea3f-45d9-b802-7a8df750145b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:46.493712 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b0e8a72a-ea3f-45d9-b802-7a8df750145b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:46.494989 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b0e8a72a-ea3f-45d9-b802-7a8df750145b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:46.495475 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b0e8a72a-ea3f-45d9-b802-7a8df750145b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:46.501876 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-e38cbcd0-4e74-458d-80b3-019dc4aa9ee3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:46.503215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-e38cbcd0-4e74-458d-80b3-019dc4aa9ee3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:46.518243 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e38cbcd0-4e74-458d-80b3-019dc4aa9ee3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:46.518660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e38cbcd0-4e74-458d-80b3-019dc4aa9ee3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:46.519657 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e38cbcd0-4e74-458d-80b3-019dc4aa9ee3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:46.520069 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e38cbcd0-4e74-458d-80b3-019dc4aa9ee3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:46.741250 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-b0e8a72a-ea3f-45d9-b802-7a8df750145b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:46.752748 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-b0e8a72a-ea3f-45d9-b802-7a8df750145b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1501 microversion: 2.1 time: 0.271347 May 16 20:39:46.758907 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 162/321] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:46 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1501 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:46.775852 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-f58a6b19-fd24-4934-9790-72e16b9870f5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f0b3e1e-12e9-47f9-ba64-536ee53267cf"}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:39:46.777550 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-f58a6b19-fd24-4934-9790-72e16b9870f5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:46.788339 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-e38cbcd0-4e74-458d-80b3-019dc4aa9ee3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:46.796739 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f58a6b19-fd24-4934-9790-72e16b9870f5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:46.797268 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f58a6b19-fd24-4934-9790-72e16b9870f5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:46.798143 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f58a6b19-fd24-4934-9790-72e16b9870f5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:46.798777 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f58a6b19-fd24-4934-9790-72e16b9870f5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:46.799049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-e38cbcd0-4e74-458d-80b3-019dc4aa9ee3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:46.801244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-e38cbcd0-4e74-458d-80b3-019dc4aa9ee3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:46.802633 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-e38cbcd0-4e74-458d-80b3-019dc4aa9ee3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.306309 May 16 20:39:46.813363 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 160/322] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:46 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:46.826793 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-f58a6b19-fd24-4934-9790-72e16b9870f5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] HTTP exception thrown: Cannot 'attach_volume' instance d02eea51-3d7f-45e0-83ee-349ebd8121f8 while it is in vm_state rescued May 16 20:39:46.828603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-f58a6b19-fd24-4934-9790-72e16b9870f5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Request method failure captured: May 16 20:39:46.828603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: POST /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8/os-volume_attachments HTTP/1.1 May 16 20:39:46.828603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:39:46.828603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:39:46.828603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:39:46.828603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 74 May 16 20:39:46.828603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:39:46.828603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:39:46.828603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:39:46.828603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:39:46.828603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrYz-yjVKwgSFfN0eLNagUyRjDkS79jG85WNDPi_wT024qE-ANQLmJ-KHEJ6Vnv8ngmMt0zEUKEE8CtESkh62DxmHenCL5YAhZjLMoCaFCWuXPk0rDXBZ7EBJ6W3SjHCtjbuNDPg0vhkDGdSnh6SHKwG6VwkTaeY6mnwE6Exhy0aLX0 May 16 20:39:46.828603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:39:46.828603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:39:46.828603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:39:46.828603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:39:46.828603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:39:46.828603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:39:46.828603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 69e39fae43c341798f00e3b48f20d003 May 16 20:39:46.828603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1585639724 May 16 20:39:46.828603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:39:46.828603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:39:46.830142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_69e39fae43c341798f00e3b48f20d003"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e39fae43c341798f00e3b48f20d003"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/69e39fae43c341798f00e3b48f20d003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e39fae43c341798f00e3b48f20d003"}]}] May 16 20:39:46.830142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1585639724 May 16 20:39:46.830142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 69e39fae43c341798f00e3b48f20d003 May 16 20:39:46.830142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1585639724 May 16 20:39:46.830142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-ServerRescueNegativeTestJSON-1585639724-project May 16 20:39:46.830142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:39:46.830142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:39:46.830142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: 20c57f1318cd4c73b2248b2d02896176 May 16 20:39:46.830142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1585639724-project May 16 20:39:46.830142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: May 16 20:39:46.830142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {"volumeAttachment": {"volumeId": "1f0b3e1e-12e9-47f9-ba64-536ee53267cf"}} May 16 20:39:46.830142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:39:46.831064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Cannot 'attach_volume' instance d02eea51-3d7f-45e0-83ee-349ebd8121f8 while it is in vm_state rescued May 16 20:39:46.831064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'server_id': 'd02eea51-3d7f-45e0-83ee-349ebd8121f8', 'body': {'volumeAttachment': {'volumeId': '1f0b3e1e-12e9-47f9-ba64-536ee53267cf'}}} May 16 20:39:46.831064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:39:46.831064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:39:46.831064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 20:39:46.831064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 20:39:46.831064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 20:39:46.831064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 20:39:46.831064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 16 20:39:46.831064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 16 20:39:46.831064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d02eea51-3d7f-45e0-83ee-349ebd8121f8 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 16 20:39:46.831064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:39:46.831064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:39:46.831064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:39:46.831064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:39:46.831064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:39:46.831064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:39:46.831064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:39:46.831064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:39:46.832319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:39:46.832319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:39:46.832319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 20:39:46.832319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 20:39:46.832319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 20:39:46.832319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 20:39:46.832319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 20:39:46.832319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 20:39:46.832319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 16 20:39:46.832319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 16 20:39:46.832319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 16 20:39:46.832319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 16 20:39:46.832319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d02eea51-3d7f-45e0-83ee-349ebd8121f8 while it is in vm_state rescued May 16 20:39:46.832319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:39:46.832319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:39:46.832319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:39:46.832319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:39:46.832319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:39:46.832319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:39:46.833594 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:39:46.833594 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:39:46.833594 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d02eea51-3d7f-45e0-83ee-349ebd8121f8 while it is in vm_state rescued May 16 20:39:46.833594 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:39:46.833594 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-f58a6b19-fd24-4934-9790-72e16b9870f5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Returning 409 to user: Cannot 'attach_volume' instance d02eea51-3d7f-45e0-83ee-349ebd8121f8 while it is in vm_state rescued {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:39:46.833594 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-f58a6b19-fd24-4934-9790-72e16b9870f5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "POST /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.059058 May 16 20:39:46.833594 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 163/323] 10.222.0.49 () {60 vars in 1322 bytes} [Mon May 16 20:39:46 2022] POST /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8/os-volume_attachments => generated 152 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 16 20:39:46.839532 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-f084aa9a-f96d-4511-927c-d786211b9f79 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:39:46.840480 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-f084aa9a-f96d-4511-927c-d786211b9f79 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:46.847213 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f084aa9a-f96d-4511-927c-d786211b9f79 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:46.847931 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f084aa9a-f96d-4511-927c-d786211b9f79 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:46.848916 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f084aa9a-f96d-4511-927c-d786211b9f79 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:46.849507 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f084aa9a-f96d-4511-927c-d786211b9f79 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:46.931980 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-f084aa9a-f96d-4511-927c-d786211b9f79 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "POST /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8/action" status: 202 len: 0 microversion: 2.1 time: 0.096365 May 16 20:39:46.935910 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 161/324] 10.222.0.49 () {60 vars in 1277 bytes} [Mon May 16 20:39:46 2022] POST /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:39:46.941034 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-9349cc27-ab1b-4615-a29c-0aa6b32b61d7 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:46.941720 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-9349cc27-ab1b-4615-a29c-0aa6b32b61d7 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:46.948280 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9349cc27-ab1b-4615-a29c-0aa6b32b61d7 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:46.948812 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9349cc27-ab1b-4615-a29c-0aa6b32b61d7 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:46.949672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9349cc27-ab1b-4615-a29c-0aa6b32b61d7 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:46.950175 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9349cc27-ab1b-4615-a29c-0aa6b32b61d7 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:47.150579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-9349cc27-ab1b-4615-a29c-0aa6b32b61d7 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:47.159749 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-9349cc27-ab1b-4615-a29c-0aa6b32b61d7 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1509 microversion: 2.1 time: 0.222588 May 16 20:39:47.160967 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 164/325] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:46 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:39:47.246003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-4544a231-8c06-4fb0-b7b9-f61af2760dfe tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:47.246990 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-4544a231-8c06-4fb0-b7b9-f61af2760dfe tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:47.254826 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4544a231-8c06-4fb0-b7b9-f61af2760dfe tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:47.255371 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4544a231-8c06-4fb0-b7b9-f61af2760dfe tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:47.256176 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4544a231-8c06-4fb0-b7b9-f61af2760dfe tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:47.256635 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4544a231-8c06-4fb0-b7b9-f61af2760dfe tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:47.411449 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-4544a231-8c06-4fb0-b7b9-f61af2760dfe tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:47.422719 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-4544a231-8c06-4fb0-b7b9-f61af2760dfe tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1357 microversion: 2.1 time: 0.181848 May 16 20:39:47.425129 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 162/326] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:47 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:47.825012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e03d223a-d581-439f-bc02-14d63f9899d3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:47.825637 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-e03d223a-d581-439f-bc02-14d63f9899d3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:47.834824 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e03d223a-d581-439f-bc02-14d63f9899d3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:47.835457 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e03d223a-d581-439f-bc02-14d63f9899d3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:47.836565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e03d223a-d581-439f-bc02-14d63f9899d3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:47.837136 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e03d223a-d581-439f-bc02-14d63f9899d3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:47.997653 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e03d223a-d581-439f-bc02-14d63f9899d3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:48.007206 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e03d223a-d581-439f-bc02-14d63f9899d3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:48.009357 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e03d223a-d581-439f-bc02-14d63f9899d3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:48.010875 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-e03d223a-d581-439f-bc02-14d63f9899d3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.192367 May 16 20:39:48.011484 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 165/327] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:47 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:48.178122 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-8ee06ea7-976c-4739-b0b5-1e4f9b0d7820 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:48.178747 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-8ee06ea7-976c-4739-b0b5-1e4f9b0d7820 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:48.187445 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8ee06ea7-976c-4739-b0b5-1e4f9b0d7820 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:48.188283 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8ee06ea7-976c-4739-b0b5-1e4f9b0d7820 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:48.189460 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8ee06ea7-976c-4739-b0b5-1e4f9b0d7820 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:48.190179 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8ee06ea7-976c-4739-b0b5-1e4f9b0d7820 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:48.341376 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-8ee06ea7-976c-4739-b0b5-1e4f9b0d7820 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:48.349193 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-8ee06ea7-976c-4739-b0b5-1e4f9b0d7820 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1509 microversion: 2.1 time: 0.175328 May 16 20:39:48.349775 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 163/328] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:48 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:39:48.442003 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-3a22b463-dea8-4ac4-80aa-ccc9dc10eb87 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:48.443035 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-3a22b463-dea8-4ac4-80aa-ccc9dc10eb87 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:48.458320 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3a22b463-dea8-4ac4-80aa-ccc9dc10eb87 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:48.458827 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3a22b463-dea8-4ac4-80aa-ccc9dc10eb87 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:48.459775 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3a22b463-dea8-4ac4-80aa-ccc9dc10eb87 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:48.460225 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3a22b463-dea8-4ac4-80aa-ccc9dc10eb87 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:48.601514 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3a22b463-dea8-4ac4-80aa-ccc9dc10eb87 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:48.614240 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-3a22b463-dea8-4ac4-80aa-ccc9dc10eb87 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1357 microversion: 2.1 time: 0.177353 May 16 20:39:48.614854 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 166/329] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:48 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:49.029913 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-637043c3-d85e-4564-bdb0-4782ff4d4a25 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:49.030816 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-637043c3-d85e-4564-bdb0-4782ff4d4a25 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:49.037410 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-637043c3-d85e-4564-bdb0-4782ff4d4a25 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:49.038121 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-637043c3-d85e-4564-bdb0-4782ff4d4a25 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:49.038903 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-637043c3-d85e-4564-bdb0-4782ff4d4a25 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:49.039373 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-637043c3-d85e-4564-bdb0-4782ff4d4a25 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:49.177497 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-637043c3-d85e-4564-bdb0-4782ff4d4a25 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:49.187611 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-637043c3-d85e-4564-bdb0-4782ff4d4a25 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:49.189160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-637043c3-d85e-4564-bdb0-4782ff4d4a25 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:49.190684 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-637043c3-d85e-4564-bdb0-4782ff4d4a25 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.165122 May 16 20:39:49.191507 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 164/330] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:49 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:49.366901 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-781c88ec-6703-4882-9e35-5ed18249b1d4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:49.368429 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-781c88ec-6703-4882-9e35-5ed18249b1d4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:49.375010 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-781c88ec-6703-4882-9e35-5ed18249b1d4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:49.375801 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-781c88ec-6703-4882-9e35-5ed18249b1d4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:49.376708 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-781c88ec-6703-4882-9e35-5ed18249b1d4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:49.377210 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-781c88ec-6703-4882-9e35-5ed18249b1d4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:49.514897 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-781c88ec-6703-4882-9e35-5ed18249b1d4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:49.522515 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-781c88ec-6703-4882-9e35-5ed18249b1d4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1509 microversion: 2.1 time: 0.159570 May 16 20:39:49.522904 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 167/331] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:49 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:49.637328 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-137cc918-3c49-4dc5-b012-467ed4e6eff7 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:49.638023 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-137cc918-3c49-4dc5-b012-467ed4e6eff7 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:49.644621 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-137cc918-3c49-4dc5-b012-467ed4e6eff7 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:49.645024 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-137cc918-3c49-4dc5-b012-467ed4e6eff7 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:49.645960 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-137cc918-3c49-4dc5-b012-467ed4e6eff7 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:49.646330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-137cc918-3c49-4dc5-b012-467ed4e6eff7 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:49.795913 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-137cc918-3c49-4dc5-b012-467ed4e6eff7 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:49.803904 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-137cc918-3c49-4dc5-b012-467ed4e6eff7 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1357 microversion: 2.1 time: 0.174021 May 16 20:39:49.804815 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 165/332] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:49 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:50.209493 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-192194be-246a-484a-b08a-2d68762e7cdc tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:50.210297 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-192194be-246a-484a-b08a-2d68762e7cdc tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:50.216963 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-192194be-246a-484a-b08a-2d68762e7cdc tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:50.217505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-192194be-246a-484a-b08a-2d68762e7cdc tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:50.218367 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-192194be-246a-484a-b08a-2d68762e7cdc tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:50.218867 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-192194be-246a-484a-b08a-2d68762e7cdc tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:50.365991 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-192194be-246a-484a-b08a-2d68762e7cdc tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:50.375202 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-192194be-246a-484a-b08a-2d68762e7cdc tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:50.377122 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-192194be-246a-484a-b08a-2d68762e7cdc tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:50.377925 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-192194be-246a-484a-b08a-2d68762e7cdc tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.172416 May 16 20:39:50.378490 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 168/333] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:50 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:50.539517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-ea7c50b7-9401-487e-91fe-7fdd390cdb24 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:50.541041 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-ea7c50b7-9401-487e-91fe-7fdd390cdb24 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:50.554290 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ea7c50b7-9401-487e-91fe-7fdd390cdb24 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:50.554747 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ea7c50b7-9401-487e-91fe-7fdd390cdb24 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:50.555627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ea7c50b7-9401-487e-91fe-7fdd390cdb24 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:50.556073 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ea7c50b7-9401-487e-91fe-7fdd390cdb24 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:50.699039 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ea7c50b7-9401-487e-91fe-7fdd390cdb24 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:50.706659 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-ea7c50b7-9401-487e-91fe-7fdd390cdb24 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1509 microversion: 2.1 time: 0.171244 May 16 20:39:50.707233 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 166/334] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:50 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:50.821474 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-cef52532-2a29-4aca-b403-b31857f1f498 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:50.822133 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-cef52532-2a29-4aca-b403-b31857f1f498 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:50.829288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cef52532-2a29-4aca-b403-b31857f1f498 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:50.829737 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cef52532-2a29-4aca-b403-b31857f1f498 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:50.830525 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cef52532-2a29-4aca-b403-b31857f1f498 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:50.830959 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cef52532-2a29-4aca-b403-b31857f1f498 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:50.971412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-cef52532-2a29-4aca-b403-b31857f1f498 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:50.979596 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-cef52532-2a29-4aca-b403-b31857f1f498 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1357 microversion: 2.1 time: 0.162404 May 16 20:39:50.980336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 169/335] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:50 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:51.396523 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-f3929afa-0dbd-47c0-8070-0d55f74cd88e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:51.397219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-f3929afa-0dbd-47c0-8070-0d55f74cd88e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:51.403981 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f3929afa-0dbd-47c0-8070-0d55f74cd88e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:51.404454 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f3929afa-0dbd-47c0-8070-0d55f74cd88e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:51.405240 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f3929afa-0dbd-47c0-8070-0d55f74cd88e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:51.405673 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f3929afa-0dbd-47c0-8070-0d55f74cd88e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:51.543960 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f3929afa-0dbd-47c0-8070-0d55f74cd88e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:51.552916 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f3929afa-0dbd-47c0-8070-0d55f74cd88e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:51.554405 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f3929afa-0dbd-47c0-8070-0d55f74cd88e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:51.555712 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-f3929afa-0dbd-47c0-8070-0d55f74cd88e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.163340 May 16 20:39:51.556391 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 167/336] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:51 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:51.724302 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-ed064c05-91e0-4d52-b8ef-c09d8a260b0d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:51.724970 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-ed064c05-91e0-4d52-b8ef-c09d8a260b0d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:51.742526 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ed064c05-91e0-4d52-b8ef-c09d8a260b0d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:51.742998 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ed064c05-91e0-4d52-b8ef-c09d8a260b0d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:51.743818 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ed064c05-91e0-4d52-b8ef-c09d8a260b0d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:51.744241 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ed064c05-91e0-4d52-b8ef-c09d8a260b0d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:51.880370 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-ed064c05-91e0-4d52-b8ef-c09d8a260b0d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:51.888588 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-ed064c05-91e0-4d52-b8ef-c09d8a260b0d tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1509 microversion: 2.1 time: 0.168703 May 16 20:39:51.889163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 170/337] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:51 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:51.998158 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-f881f41f-f36f-4b28-b5cd-0762b316f198 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:51.999113 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-f881f41f-f36f-4b28-b5cd-0762b316f198 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:52.006518 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f881f41f-f36f-4b28-b5cd-0762b316f198 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:52.006946 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f881f41f-f36f-4b28-b5cd-0762b316f198 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:52.008236 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f881f41f-f36f-4b28-b5cd-0762b316f198 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:52.008696 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f881f41f-f36f-4b28-b5cd-0762b316f198 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:52.155911 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f881f41f-f36f-4b28-b5cd-0762b316f198 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:52.164223 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-f881f41f-f36f-4b28-b5cd-0762b316f198 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1357 microversion: 2.1 time: 0.170890 May 16 20:39:52.172127 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 168/338] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:51 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:52.574718 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a7625677-88ed-472f-ab2e-98a89fcf11c5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:52.575346 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-a7625677-88ed-472f-ab2e-98a89fcf11c5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:52.581918 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a7625677-88ed-472f-ab2e-98a89fcf11c5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:52.583144 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a7625677-88ed-472f-ab2e-98a89fcf11c5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:52.584046 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a7625677-88ed-472f-ab2e-98a89fcf11c5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:52.584636 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a7625677-88ed-472f-ab2e-98a89fcf11c5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:52.725618 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a7625677-88ed-472f-ab2e-98a89fcf11c5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:52.737932 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a7625677-88ed-472f-ab2e-98a89fcf11c5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:52.739468 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a7625677-88ed-472f-ab2e-98a89fcf11c5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:52.740700 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-a7625677-88ed-472f-ab2e-98a89fcf11c5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.170013 May 16 20:39:52.741255 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 171/339] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:52 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:52.906108 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2db442fd-f3ce-4e2b-9972-52d202cbf977 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:52.906732 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-2db442fd-f3ce-4e2b-9972-52d202cbf977 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:52.914047 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2db442fd-f3ce-4e2b-9972-52d202cbf977 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:52.914821 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2db442fd-f3ce-4e2b-9972-52d202cbf977 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:52.915836 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2db442fd-f3ce-4e2b-9972-52d202cbf977 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:52.916529 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2db442fd-f3ce-4e2b-9972-52d202cbf977 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:53.056199 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-2db442fd-f3ce-4e2b-9972-52d202cbf977 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:53.064476 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-2db442fd-f3ce-4e2b-9972-52d202cbf977 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1509 microversion: 2.1 time: 0.161792 May 16 20:39:53.065576 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 169/340] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:52 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:53.182252 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-0e7cdd6e-3516-4f98-a249-39281d79823b tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:53.182894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-0e7cdd6e-3516-4f98-a249-39281d79823b tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:53.189353 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0e7cdd6e-3516-4f98-a249-39281d79823b tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:53.189797 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0e7cdd6e-3516-4f98-a249-39281d79823b tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:53.190567 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0e7cdd6e-3516-4f98-a249-39281d79823b tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:53.191001 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0e7cdd6e-3516-4f98-a249-39281d79823b tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:53.325063 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-0e7cdd6e-3516-4f98-a249-39281d79823b tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:53.335444 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-0e7cdd6e-3516-4f98-a249-39281d79823b tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1357 microversion: 2.1 time: 0.157177 May 16 20:39:53.336269 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 172/341] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:53 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:39:53.763548 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-f84c05ff-f99f-448e-bf8e-2b3779d5cd53 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:53.764651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-f84c05ff-f99f-448e-bf8e-2b3779d5cd53 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:53.773673 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f84c05ff-f99f-448e-bf8e-2b3779d5cd53 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:53.774129 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f84c05ff-f99f-448e-bf8e-2b3779d5cd53 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:53.775021 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f84c05ff-f99f-448e-bf8e-2b3779d5cd53 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:53.775469 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f84c05ff-f99f-448e-bf8e-2b3779d5cd53 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:53.917844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f84c05ff-f99f-448e-bf8e-2b3779d5cd53 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:53.927394 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f84c05ff-f99f-448e-bf8e-2b3779d5cd53 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:53.929178 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f84c05ff-f99f-448e-bf8e-2b3779d5cd53 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:53.930547 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-f84c05ff-f99f-448e-bf8e-2b3779d5cd53 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.171781 May 16 20:39:53.931515 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 170/342] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:53 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:54.081510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-92441db4-e385-4b2e-87c6-aa8e4d7829d2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:54.082103 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-92441db4-e385-4b2e-87c6-aa8e4d7829d2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:54.088634 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-92441db4-e385-4b2e-87c6-aa8e4d7829d2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:54.089099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-92441db4-e385-4b2e-87c6-aa8e4d7829d2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:54.089849 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-92441db4-e385-4b2e-87c6-aa8e4d7829d2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:54.090550 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-92441db4-e385-4b2e-87c6-aa8e4d7829d2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:54.236151 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-92441db4-e385-4b2e-87c6-aa8e4d7829d2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:54.243971 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-92441db4-e385-4b2e-87c6-aa8e4d7829d2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1509 microversion: 2.1 time: 0.166487 May 16 20:39:54.244848 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 173/343] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:54 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:54.353731 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-290e5652-2e82-409d-b756-d986a9e7ab7d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:54.354269 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-290e5652-2e82-409d-b756-d986a9e7ab7d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:54.360557 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-290e5652-2e82-409d-b756-d986a9e7ab7d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:54.361010 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-290e5652-2e82-409d-b756-d986a9e7ab7d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:54.361777 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-290e5652-2e82-409d-b756-d986a9e7ab7d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:54.362222 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-290e5652-2e82-409d-b756-d986a9e7ab7d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:54.511223 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-290e5652-2e82-409d-b756-d986a9e7ab7d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:54.518958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-290e5652-2e82-409d-b756-d986a9e7ab7d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1357 microversion: 2.1 time: 0.169262 May 16 20:39:54.527946 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 171/344] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:54 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:54.542615 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-5da971c1-574c-4d73-a321-e09d56e61faf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:54.543110 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-5da971c1-574c-4d73-a321-e09d56e61faf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:54.549245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5da971c1-574c-4d73-a321-e09d56e61faf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:54.549691 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5da971c1-574c-4d73-a321-e09d56e61faf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:54.550822 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5da971c1-574c-4d73-a321-e09d56e61faf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:54.551265 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5da971c1-574c-4d73-a321-e09d56e61faf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:54.575791 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-5da971c1-574c-4d73-a321-e09d56e61faf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50/ips" status: 200 len: 151 microversion: 2.1 time: 0.036811 May 16 20:39:54.576841 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 174/345] 10.222.0.49 () {58 vars in 1247 bytes} [Mon May 16 20:39:54 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:39:54.587476 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0de8d520-cd4a-40f5-9a75-542cabb524fd tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf3dd65c-238f-49c0-af99-eed77cce339b"}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:39:54.588687 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0de8d520-cd4a-40f5-9a75-542cabb524fd tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:54.595526 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0de8d520-cd4a-40f5-9a75-542cabb524fd tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:54.595991 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0de8d520-cd4a-40f5-9a75-542cabb524fd tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:54.596808 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0de8d520-cd4a-40f5-9a75-542cabb524fd tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:54.597281 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0de8d520-cd4a-40f5-9a75-542cabb524fd tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:54.689709 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-0de8d520-cd4a-40f5-9a75-542cabb524fd tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] HTTP exception thrown: Invalid volume: volume bf3dd65c-238f-49c0-af99-eed77cce339b is already attached to instances: df423e7b-a5e3-4c9a-adbc-b64a2afd9752 May 16 20:39:54.691153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0de8d520-cd4a-40f5-9a75-542cabb524fd tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Request method failure captured: May 16 20:39:54.691153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: POST /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50/os-volume_attachments HTTP/1.1 May 16 20:39:54.691153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:39:54.691153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:39:54.691153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:39:54.691153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 74 May 16 20:39:54.691153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:39:54.691153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:39:54.691153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:39:54.691153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:39:54.691153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrXoPH7QRaaUNABjfpjkYuYjuc4YT0JGIT87HUhaS5B5EXLX9gs5SGdefatz8rk10ofLrDlfVl0DHS_o7l3BlYtbJjSH31X6xpm4OYuntjQCYXgO_XFh2HlouaxMKjcOnmFJvaHNJ-XXm3gC4mA2DpJBa428rLJJY3RCeZ4NRvaKM9I May 16 20:39:54.691153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:39:54.691153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:39:54.691153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:39:54.691153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:39:54.691153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:39:54.691153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:39:54.691153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:39:54.691153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:39:54.691153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:39:54.691153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:39:54.692597 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}] May 16 20:39:54.692597 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:39:54.692597 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:39:54.692597 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:39:54.692597 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:39:54.692597 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:39:54.692597 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:39:54.692597 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: b578680e88c741bda2c8e56b2dc9d335 May 16 20:39:54.692597 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:39:54.692597 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: May 16 20:39:54.692597 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {"volumeAttachment": {"volumeId": "bf3dd65c-238f-49c0-af99-eed77cce339b"}} May 16 20:39:54.692597 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: > May 16 20:39:54.693512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Invalid volume: volume bf3dd65c-238f-49c0-af99-eed77cce339b is already attached to instances: df423e7b-a5e3-4c9a-adbc-b64a2afd9752 May 16 20:39:54.693512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'server_id': '36eca126-3242-483f-a941-432265ebaf50', 'body': {'volumeAttachment': {'volumeId': 'bf3dd65c-238f-49c0-af99-eed77cce339b'}}} May 16 20:39:54.693512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:39:54.693512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:39:54.693512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 20:39:54.693512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 20:39:54.693512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 20:39:54.693512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 20:39:54.693512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 16 20:39:54.693512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 16 20:39:54.693512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 16 20:39:54.693512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 16 20:39:54.693512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 16 20:39:54.693512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 16 20:39:54.693512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bf3dd65c-238f-49c0-af99-eed77cce339b is already attached to instances: df423e7b-a5e3-4c9a-adbc-b64a2afd9752 May 16 20:39:54.693512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:39:54.693512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:39:54.693512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:39:54.693512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:39:54.694968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:39:54.694968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:39:54.694968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:39:54.694968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:39:54.694968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:39:54.694968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:39:54.694968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 20:39:54.694968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 20:39:54.694968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 20:39:54.694968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 20:39:54.694968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 20:39:54.694968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 20:39:54.694968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 16 20:39:54.694968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 16 20:39:54.694968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bf3dd65c-238f-49c0-af99-eed77cce339b is already attached to instances: df423e7b-a5e3-4c9a-adbc-b64a2afd9752 May 16 20:39:54.694968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:39:54.694968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:39:54.694968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:39:54.694968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:39:54.694968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:39:54.696487 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:39:54.696487 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:39:54.696487 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:39:54.696487 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bf3dd65c-238f-49c0-af99-eed77cce339b is already attached to instances: df423e7b-a5e3-4c9a-adbc-b64a2afd9752 May 16 20:39:54.696487 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:39:54.696487 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0de8d520-cd4a-40f5-9a75-542cabb524fd tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Returning 400 to user: Invalid volume: volume bf3dd65c-238f-49c0-af99-eed77cce339b is already attached to instances: df423e7b-a5e3-4c9a-adbc-b64a2afd9752 {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:39:54.696487 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0de8d520-cd4a-40f5-9a75-542cabb524fd tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "POST /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109524 May 16 20:39:54.696487 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 172/346] 10.222.0.49 () {60 vars in 1322 bytes} [Mon May 16 20:39:54 2022] POST /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 16 20:39:54.701897 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-9258a09c-43d2-4bcb-8072-2f51a31be12a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:54.702545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-9258a09c-43d2-4bcb-8072-2f51a31be12a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:54.708841 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9258a09c-43d2-4bcb-8072-2f51a31be12a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:54.709292 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9258a09c-43d2-4bcb-8072-2f51a31be12a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:54.710086 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9258a09c-43d2-4bcb-8072-2f51a31be12a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:54.710540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9258a09c-43d2-4bcb-8072-2f51a31be12a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:54.736361 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-9258a09c-43d2-4bcb-8072-2f51a31be12a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Going to try to terminate instance {{(pid=123564) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:39:54.823252 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-9258a09c-43d2-4bcb-8072-2f51a31be12a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "DELETE /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 204 len: 0 microversion: 2.1 time: 0.124796 May 16 20:39:54.823850 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 175/347] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:39:54 2022] DELETE /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 20:39:54.841879 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-8d9c82fd-3b8e-4801-8e12-a4e80c641fcd tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:54.850530 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-8d9c82fd-3b8e-4801-8e12-a4e80c641fcd tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:54.859647 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8d9c82fd-3b8e-4801-8e12-a4e80c641fcd tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:54.865040 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8d9c82fd-3b8e-4801-8e12-a4e80c641fcd tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:54.866033 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8d9c82fd-3b8e-4801-8e12-a4e80c641fcd tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:54.866637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8d9c82fd-3b8e-4801-8e12-a4e80c641fcd tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:54.949085 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-cfb82103-0731-44da-846a-361a8c0db275 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:54.950028 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-cfb82103-0731-44da-846a-361a8c0db275 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:54.975840 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cfb82103-0731-44da-846a-361a8c0db275 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:54.976664 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cfb82103-0731-44da-846a-361a8c0db275 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:54.977427 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cfb82103-0731-44da-846a-361a8c0db275 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:54.978115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cfb82103-0731-44da-846a-361a8c0db275 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:55.039946 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-8d9c82fd-3b8e-4801-8e12-a4e80c641fcd tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:55.048386 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-8d9c82fd-3b8e-4801-8e12-a4e80c641fcd tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1680 microversion: 2.1 time: 0.220070 May 16 20:39:55.049247 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 173/348] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:54 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:55.131503 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-cfb82103-0731-44da-846a-361a8c0db275 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:55.141129 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-cfb82103-0731-44da-846a-361a8c0db275 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:55.147155 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-cfb82103-0731-44da-846a-361a8c0db275 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:55.148407 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-cfb82103-0731-44da-846a-361a8c0db275 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.203691 May 16 20:39:55.149026 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 176/349] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:54 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:39:55.261446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-75cca643-637d-4217-b783-28a316c0deb0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:55.262058 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-75cca643-637d-4217-b783-28a316c0deb0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:55.268687 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-75cca643-637d-4217-b783-28a316c0deb0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:55.269146 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-75cca643-637d-4217-b783-28a316c0deb0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:55.269939 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-75cca643-637d-4217-b783-28a316c0deb0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:55.270360 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-75cca643-637d-4217-b783-28a316c0deb0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:55.423846 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-75cca643-637d-4217-b783-28a316c0deb0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:55.432606 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-75cca643-637d-4217-b783-28a316c0deb0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1509 microversion: 2.1 time: 0.175058 May 16 20:39:55.433195 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 174/350] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:55 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:55.535353 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-2918f3f8-dc69-4c2b-8ef9-f9f95f627ef6 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:55.535979 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-2918f3f8-dc69-4c2b-8ef9-f9f95f627ef6 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:55.542554 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2918f3f8-dc69-4c2b-8ef9-f9f95f627ef6 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:55.543009 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2918f3f8-dc69-4c2b-8ef9-f9f95f627ef6 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:55.543792 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2918f3f8-dc69-4c2b-8ef9-f9f95f627ef6 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:55.544720 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2918f3f8-dc69-4c2b-8ef9-f9f95f627ef6 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:55.683354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2918f3f8-dc69-4c2b-8ef9-f9f95f627ef6 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:55.691158 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-2918f3f8-dc69-4c2b-8ef9-f9f95f627ef6 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1357 microversion: 2.1 time: 0.159693 May 16 20:39:55.698923 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 177/351] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:55 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:56.067986 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-01321d23-d786-496b-97b3-eb10b5bc093a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:56.068673 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-01321d23-d786-496b-97b3-eb10b5bc093a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:56.075380 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-01321d23-d786-496b-97b3-eb10b5bc093a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:56.075832 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-01321d23-d786-496b-97b3-eb10b5bc093a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:56.076658 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-01321d23-d786-496b-97b3-eb10b5bc093a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:56.077094 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-01321d23-d786-496b-97b3-eb10b5bc093a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:56.167208 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-0c521dab-d4bd-44e9-8a67-f522d71a766c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:56.167816 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-0c521dab-d4bd-44e9-8a67-f522d71a766c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:56.174597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0c521dab-d4bd-44e9-8a67-f522d71a766c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:56.175054 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0c521dab-d4bd-44e9-8a67-f522d71a766c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:56.176464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0c521dab-d4bd-44e9-8a67-f522d71a766c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:56.176937 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0c521dab-d4bd-44e9-8a67-f522d71a766c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:56.209056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-01321d23-d786-496b-97b3-eb10b5bc093a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:56.216955 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-01321d23-d786-496b-97b3-eb10b5bc093a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1680 microversion: 2.1 time: 0.152804 May 16 20:39:56.219904 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 175/352] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:56 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:56.307395 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-0c521dab-d4bd-44e9-8a67-f522d71a766c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:56.315758 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-0c521dab-d4bd-44e9-8a67-f522d71a766c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:56.317277 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-0c521dab-d4bd-44e9-8a67-f522d71a766c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:56.318492 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-0c521dab-d4bd-44e9-8a67-f522d71a766c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.155459 May 16 20:39:56.319050 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 178/353] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:56 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:56.452233 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-6b11a3a7-1304-401b-9a0d-fc25bcc73609 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:56.453019 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-6b11a3a7-1304-401b-9a0d-fc25bcc73609 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:56.461022 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6b11a3a7-1304-401b-9a0d-fc25bcc73609 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:56.461582 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6b11a3a7-1304-401b-9a0d-fc25bcc73609 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:56.462525 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6b11a3a7-1304-401b-9a0d-fc25bcc73609 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:56.463067 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6b11a3a7-1304-401b-9a0d-fc25bcc73609 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:56.616472 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-6b11a3a7-1304-401b-9a0d-fc25bcc73609 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:56.625132 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-6b11a3a7-1304-401b-9a0d-fc25bcc73609 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1509 microversion: 2.1 time: 0.177704 May 16 20:39:56.625704 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 176/354] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:56 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:56.708593 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-9436477c-dd8a-4c8b-adb7-d9fbe478131d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:56.709204 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-9436477c-dd8a-4c8b-adb7-d9fbe478131d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:56.715863 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9436477c-dd8a-4c8b-adb7-d9fbe478131d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:56.716304 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9436477c-dd8a-4c8b-adb7-d9fbe478131d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:56.717106 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9436477c-dd8a-4c8b-adb7-d9fbe478131d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:56.717529 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9436477c-dd8a-4c8b-adb7-d9fbe478131d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:56.849643 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-9436477c-dd8a-4c8b-adb7-d9fbe478131d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:56.857261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-9436477c-dd8a-4c8b-adb7-d9fbe478131d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1357 microversion: 2.1 time: 0.152589 May 16 20:39:56.857855 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 179/355] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:56 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:57.235642 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-fdd3dca8-6aef-472a-a1a8-659576b1c7e3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:57.236338 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-fdd3dca8-6aef-472a-a1a8-659576b1c7e3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:57.242814 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fdd3dca8-6aef-472a-a1a8-659576b1c7e3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:57.243279 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fdd3dca8-6aef-472a-a1a8-659576b1c7e3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:57.244145 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fdd3dca8-6aef-472a-a1a8-659576b1c7e3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:57.244613 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fdd3dca8-6aef-472a-a1a8-659576b1c7e3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:57.337614 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6c8ef291-0d60-4891-8fdb-583197411ade tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:57.338410 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-6c8ef291-0d60-4891-8fdb-583197411ade tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:57.345645 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6c8ef291-0d60-4891-8fdb-583197411ade tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:57.345882 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6c8ef291-0d60-4891-8fdb-583197411ade tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:57.346810 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6c8ef291-0d60-4891-8fdb-583197411ade tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:57.347324 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6c8ef291-0d60-4891-8fdb-583197411ade tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:57.384263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-fdd3dca8-6aef-472a-a1a8-659576b1c7e3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:57.391913 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-fdd3dca8-6aef-472a-a1a8-659576b1c7e3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1680 microversion: 2.1 time: 0.160520 May 16 20:39:57.396663 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 177/356] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:57 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:57.397446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-637d8efc-5850-4fd5-a2a3-2dca7bc61a9a req-a13572f2-8c17-4fe0-a1e1-8bda3f25c08a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97c97db-14c0-47b5-b7dc-4a0fab17b32f", "tag": "ebd68081-2a96-4732-bf76-3afb6eec8000"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:39:57.406019 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-637d8efc-5850-4fd5-a2a3-2dca7bc61a9a req-a13572f2-8c17-4fe0-a1e1-8bda3f25c08a service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:57.406709 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-637d8efc-5850-4fd5-a2a3-2dca7bc61a9a req-a13572f2-8c17-4fe0-a1e1-8bda3f25c08a service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:57.418776 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-637d8efc-5850-4fd5-a2a3-2dca7bc61a9a req-a13572f2-8c17-4fe0-a1e1-8bda3f25c08a service nova] Creating event network-changed:ebd68081-2a96-4732-bf76-3afb6eec8000 for instance f97c97db-14c0-47b5-b7dc-4a0fab17b32f on hv-cinder-77703 May 16 20:39:57.424216 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-637d8efc-5850-4fd5-a2a3-2dca7bc61a9a req-a13572f2-8c17-4fe0-a1e1-8bda3f25c08a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030041 May 16 20:39:57.425805 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 178/357] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:39:57.493275 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6c8ef291-0d60-4891-8fdb-583197411ade tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:57.501985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6c8ef291-0d60-4891-8fdb-583197411ade tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:57.503478 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6c8ef291-0d60-4891-8fdb-583197411ade tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:57.504688 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-6c8ef291-0d60-4891-8fdb-583197411ade tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.171556 May 16 20:39:57.505244 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 180/358] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:57 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:57.642982 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-5e966035-2f95-4f41-8be5-b54aa558b244 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:57.643677 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-5e966035-2f95-4f41-8be5-b54aa558b244 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:57.650949 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5e966035-2f95-4f41-8be5-b54aa558b244 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:57.651573 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5e966035-2f95-4f41-8be5-b54aa558b244 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:57.652330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5e966035-2f95-4f41-8be5-b54aa558b244 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:57.652997 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5e966035-2f95-4f41-8be5-b54aa558b244 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:57.786048 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-5e966035-2f95-4f41-8be5-b54aa558b244 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:57.796035 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-5e966035-2f95-4f41-8be5-b54aa558b244 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1509 microversion: 2.1 time: 0.157297 May 16 20:39:57.796672 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 179/359] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:57 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:57.878144 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-328f8ba2-c2c6-4e92-b925-68758f36b973 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:57.879139 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-328f8ba2-c2c6-4e92-b925-68758f36b973 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:57.887669 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-328f8ba2-c2c6-4e92-b925-68758f36b973 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:57.888197 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-328f8ba2-c2c6-4e92-b925-68758f36b973 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:57.888942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-328f8ba2-c2c6-4e92-b925-68758f36b973 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:57.889374 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-328f8ba2-c2c6-4e92-b925-68758f36b973 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:58.016406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-328f8ba2-c2c6-4e92-b925-68758f36b973 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:58.023851 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-328f8ba2-c2c6-4e92-b925-68758f36b973 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1357 microversion: 2.1 time: 0.152317 May 16 20:39:58.024390 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 181/360] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:57 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:58.413489 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-31417b63-f29d-411e-ba51-1d04c02d1bb6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:58.414489 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-31417b63-f29d-411e-ba51-1d04c02d1bb6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:58.421734 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-31417b63-f29d-411e-ba51-1d04c02d1bb6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:58.422179 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-31417b63-f29d-411e-ba51-1d04c02d1bb6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:58.422922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-31417b63-f29d-411e-ba51-1d04c02d1bb6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:58.423360 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-31417b63-f29d-411e-ba51-1d04c02d1bb6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:58.523118 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-35450811-40c0-42ff-bc09-4ee1f30a4635 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:58.524028 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-35450811-40c0-42ff-bc09-4ee1f30a4635 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:58.532720 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-35450811-40c0-42ff-bc09-4ee1f30a4635 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:58.533491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-35450811-40c0-42ff-bc09-4ee1f30a4635 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:58.534415 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-35450811-40c0-42ff-bc09-4ee1f30a4635 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:58.535136 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-35450811-40c0-42ff-bc09-4ee1f30a4635 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:58.561963 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-31417b63-f29d-411e-ba51-1d04c02d1bb6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:58.569648 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-31417b63-f29d-411e-ba51-1d04c02d1bb6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1680 microversion: 2.1 time: 0.162734 May 16 20:39:58.570307 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 180/361] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:58 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:58.666655 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-35450811-40c0-42ff-bc09-4ee1f30a4635 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:58.675674 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-35450811-40c0-42ff-bc09-4ee1f30a4635 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:58.677239 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-35450811-40c0-42ff-bc09-4ee1f30a4635 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:58.678412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-35450811-40c0-42ff-bc09-4ee1f30a4635 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.159270 May 16 20:39:58.678937 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 182/362] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:58 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:58.817647 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2098e1cf-7d45-457f-b3b9-00b54944e73e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:58.818643 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-2098e1cf-7d45-457f-b3b9-00b54944e73e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:58.828933 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2098e1cf-7d45-457f-b3b9-00b54944e73e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:58.829672 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2098e1cf-7d45-457f-b3b9-00b54944e73e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:58.830930 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2098e1cf-7d45-457f-b3b9-00b54944e73e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:58.831640 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2098e1cf-7d45-457f-b3b9-00b54944e73e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:58.969895 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-2098e1cf-7d45-457f-b3b9-00b54944e73e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:58.977716 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-2098e1cf-7d45-457f-b3b9-00b54944e73e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1509 microversion: 2.1 time: 0.166624 May 16 20:39:58.978272 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 181/363] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:58 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:59.040475 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-9324869a-71a4-4419-a146-211345b78d15 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:59.041098 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-9324869a-71a4-4419-a146-211345b78d15 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:59.047466 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9324869a-71a4-4419-a146-211345b78d15 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:59.047911 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9324869a-71a4-4419-a146-211345b78d15 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:59.048704 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9324869a-71a4-4419-a146-211345b78d15 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:59.049132 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9324869a-71a4-4419-a146-211345b78d15 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:59.200389 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-9324869a-71a4-4419-a146-211345b78d15 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:59.211356 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-9324869a-71a4-4419-a146-211345b78d15 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1357 microversion: 2.1 time: 0.174887 May 16 20:39:59.212066 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 183/364] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:59 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:59.589614 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-a6ad3e1e-857e-4546-ba10-88200bbc14d4 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:59.590302 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-a6ad3e1e-857e-4546-ba10-88200bbc14d4 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:59.599283 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a6ad3e1e-857e-4546-ba10-88200bbc14d4 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:59.599904 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a6ad3e1e-857e-4546-ba10-88200bbc14d4 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:59.600988 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a6ad3e1e-857e-4546-ba10-88200bbc14d4 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:59.601605 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a6ad3e1e-857e-4546-ba10-88200bbc14d4 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:59.696785 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-69a6a5ed-4f58-4cd2-bea1-6bc37e15e252 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:39:59.697480 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-69a6a5ed-4f58-4cd2-bea1-6bc37e15e252 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:39:59.703806 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-69a6a5ed-4f58-4cd2-bea1-6bc37e15e252 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:59.704348 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-69a6a5ed-4f58-4cd2-bea1-6bc37e15e252 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:59.705218 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-69a6a5ed-4f58-4cd2-bea1-6bc37e15e252 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:39:59.705726 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-69a6a5ed-4f58-4cd2-bea1-6bc37e15e252 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:39:59.760885 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a6ad3e1e-857e-4546-ba10-88200bbc14d4 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:59.769723 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-a6ad3e1e-857e-4546-ba10-88200bbc14d4 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1680 microversion: 2.1 time: 0.185504 May 16 20:39:59.770485 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 182/365] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:59 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:39:59.880501 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-69a6a5ed-4f58-4cd2-bea1-6bc37e15e252 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:59.889142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-69a6a5ed-4f58-4cd2-bea1-6bc37e15e252 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:59.890628 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-69a6a5ed-4f58-4cd2-bea1-6bc37e15e252 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:39:59.891792 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-69a6a5ed-4f58-4cd2-bea1-6bc37e15e252 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.199110 May 16 20:39:59.892319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 184/366] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:39:59 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:39:59.999122 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-b6b52f61-be5e-485c-9b51-e472af7f05e3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:00.000128 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-b6b52f61-be5e-485c-9b51-e472af7f05e3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:00.010108 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b6b52f61-be5e-485c-9b51-e472af7f05e3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:00.010562 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b6b52f61-be5e-485c-9b51-e472af7f05e3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:00.011339 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b6b52f61-be5e-485c-9b51-e472af7f05e3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:00.011822 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b6b52f61-be5e-485c-9b51-e472af7f05e3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:00.146205 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-b6b52f61-be5e-485c-9b51-e472af7f05e3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:00.154271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-b6b52f61-be5e-485c-9b51-e472af7f05e3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1509 microversion: 2.1 time: 0.161614 May 16 20:40:00.154923 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 183/367] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:39:59 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:00.189230 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-542e2bb0-9d15-44fe-af0c-4834cd9ff4fd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-752753696", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1538528591", "security_groups": [{"name": "tempest-secgroup-smoke-2122782084"}], "block_device_mapping_v2": [{"uuid": "ef7250c7-95db-4adb-ae93-697c51aa118f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f4ce36dc-b331-48ab-b5b5-0de5501adc95"}]}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:00.232405 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-c570b8cd-fed5-4aa6-b919-cc955fcb1c29 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:00.233060 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-c570b8cd-fed5-4aa6-b919-cc955fcb1c29 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:00.239531 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c570b8cd-fed5-4aa6-b919-cc955fcb1c29 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:00.239981 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c570b8cd-fed5-4aa6-b919-cc955fcb1c29 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:00.240838 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c570b8cd-fed5-4aa6-b919-cc955fcb1c29 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:00.241279 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c570b8cd-fed5-4aa6-b919-cc955fcb1c29 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:00.333043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.network.neutron [None req-542e2bb0-9d15-44fe-af0c-4834cd9ff4fd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] validate_networks() for [('f4ce36dc-b331-48ab-b5b5-0de5501adc95', None, None, None, None, None)] {{(pid=123564) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:40:00.444102 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-c570b8cd-fed5-4aa6-b919-cc955fcb1c29 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:00.451877 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-c570b8cd-fed5-4aa6-b919-cc955fcb1c29 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1357 microversion: 2.1 time: 0.223680 May 16 20:40:00.452468 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 184/368] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:00 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:00.725541 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-542e2bb0-9d15-44fe-af0c-4834cd9ff4fd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Flavor limits 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:40:00.726350 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-542e2bb0-9d15-44fe-af0c-4834cd9ff4fd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Image limits 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:40:00.727079 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-542e2bb0-9d15-44fe-af0c-4834cd9ff4fd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Flavor pref 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:40:00.727730 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-542e2bb0-9d15-44fe-af0c-4834cd9ff4fd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Image pref 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:40:00.728332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-542e2bb0-9d15-44fe-af0c-4834cd9ff4fd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:40:00.738127 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-542e2bb0-9d15-44fe-af0c-4834cd9ff4fd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:00.738576 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-542e2bb0-9d15-44fe-af0c-4834cd9ff4fd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:00.739454 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-542e2bb0-9d15-44fe-af0c-4834cd9ff4fd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:00.739825 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-542e2bb0-9d15-44fe-af0c-4834cd9ff4fd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:00.757700 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-542e2bb0-9d15-44fe-af0c-4834cd9ff4fd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Getting quotas for project 710ecde5160640149c693e0c2b0b0354. Resources: {'cores', 'ram', 'instances'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:40:00.762117 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-542e2bb0-9d15-44fe-af0c-4834cd9ff4fd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Getting quotas for user 6fa431ce09e44b85b61af972bbce2ed4 and project 710ecde5160640149c693e0c2b0b0354. Resources: {'cores', 'ram', 'instances'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:40:00.787213 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-4c83ce3a-4221-4eb7-9774-0d8efc215dfb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:00.787935 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-4c83ce3a-4221-4eb7-9774-0d8efc215dfb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:00.794860 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4c83ce3a-4221-4eb7-9774-0d8efc215dfb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:00.795413 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4c83ce3a-4221-4eb7-9774-0d8efc215dfb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:00.796263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4c83ce3a-4221-4eb7-9774-0d8efc215dfb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:00.796807 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4c83ce3a-4221-4eb7-9774-0d8efc215dfb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:00.820636 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-542e2bb0-9d15-44fe-af0c-4834cd9ff4fd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Going to run 1 instances... {{(pid=123564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:40:00.822763 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-542e2bb0-9d15-44fe-af0c-4834cd9ff4fd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ef7250c7-95db-4adb-ae93-697c51aa118f',volume_size=None,volume_type=None)] {{(pid=123564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:40:00.930393 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-4c83ce3a-4221-4eb7-9774-0d8efc215dfb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:00.938531 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-4c83ce3a-4221-4eb7-9774-0d8efc215dfb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1680 microversion: 2.1 time: 0.155195 May 16 20:40:00.939308 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 185/369] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:00 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:00.943781 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-f38a5252-7e57-44f8-b083-3a2d11489f3b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:00.944387 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-f38a5252-7e57-44f8-b083-3a2d11489f3b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:00.950309 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f38a5252-7e57-44f8-b083-3a2d11489f3b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:00.950758 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f38a5252-7e57-44f8-b083-3a2d11489f3b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:00.951523 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f38a5252-7e57-44f8-b083-3a2d11489f3b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:00.951956 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f38a5252-7e57-44f8-b083-3a2d11489f3b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:00.965166 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-542e2bb0-9d15-44fe-af0c-4834cd9ff4fd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.779847 May 16 20:40:00.965821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 185/370] 10.222.0.49 () {60 vars in 1146 bytes} [Mon May 16 20:40:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 20:40:00.975908 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-2eb6d51c-73bb-47ae-bd31-caa99ad643e9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:00.976481 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-2eb6d51c-73bb-47ae-bd31-caa99ad643e9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:01.051638 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2eb6d51c-73bb-47ae-bd31-caa99ad643e9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:01.058814 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-2eb6d51c-73bb-47ae-bd31-caa99ad643e9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1094 microversion: 2.1 time: 0.086818 May 16 20:40:01.059567 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 186/371] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:00 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:40:01.108871 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f38a5252-7e57-44f8-b083-3a2d11489f3b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:01.117538 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f38a5252-7e57-44f8-b083-3a2d11489f3b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:01.119578 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f38a5252-7e57-44f8-b083-3a2d11489f3b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:01.120852 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-f38a5252-7e57-44f8-b083-3a2d11489f3b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.180664 May 16 20:40:01.121500 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 186/372] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:40:00 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:40:01.172851 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-603ddb48-c17a-4c4e-a490-25224da8f897 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:01.173480 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-603ddb48-c17a-4c4e-a490-25224da8f897 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:01.180897 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-603ddb48-c17a-4c4e-a490-25224da8f897 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:01.181383 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-603ddb48-c17a-4c4e-a490-25224da8f897 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:01.182183 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-603ddb48-c17a-4c4e-a490-25224da8f897 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:01.182597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-603ddb48-c17a-4c4e-a490-25224da8f897 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:01.312557 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-603ddb48-c17a-4c4e-a490-25224da8f897 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:01.320305 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-603ddb48-c17a-4c4e-a490-25224da8f897 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1509 microversion: 2.1 time: 0.152700 May 16 20:40:01.320751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 187/373] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:01 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:01.472770 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-ddb44444-1558-4360-bdcc-68bbdf6dff55 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:01.473785 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-ddb44444-1558-4360-bdcc-68bbdf6dff55 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:01.482436 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ddb44444-1558-4360-bdcc-68bbdf6dff55 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:01.482889 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ddb44444-1558-4360-bdcc-68bbdf6dff55 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:01.483664 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ddb44444-1558-4360-bdcc-68bbdf6dff55 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:01.484103 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ddb44444-1558-4360-bdcc-68bbdf6dff55 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:01.612163 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ddb44444-1558-4360-bdcc-68bbdf6dff55 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:01.619603 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-ddb44444-1558-4360-bdcc-68bbdf6dff55 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1357 microversion: 2.1 time: 0.153331 May 16 20:40:01.620171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 187/374] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:01 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:01.957960 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-623580c0-6dc4-41ff-b2a4-acb55394ed68 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:01.958803 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-623580c0-6dc4-41ff-b2a4-acb55394ed68 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:01.966669 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-623580c0-6dc4-41ff-b2a4-acb55394ed68 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:01.967156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-623580c0-6dc4-41ff-b2a4-acb55394ed68 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:01.967928 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-623580c0-6dc4-41ff-b2a4-acb55394ed68 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:01.968358 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-623580c0-6dc4-41ff-b2a4-acb55394ed68 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:02.077481 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7a9c7c74-fd74-4bd9-8638-2110670c2866 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:02.078325 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-7a9c7c74-fd74-4bd9-8638-2110670c2866 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:02.086276 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7a9c7c74-fd74-4bd9-8638-2110670c2866 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:02.086707 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7a9c7c74-fd74-4bd9-8638-2110670c2866 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:02.087570 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7a9c7c74-fd74-4bd9-8638-2110670c2866 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:02.088120 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7a9c7c74-fd74-4bd9-8638-2110670c2866 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:02.099995 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-623580c0-6dc4-41ff-b2a4-acb55394ed68 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:02.109904 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-623580c0-6dc4-41ff-b2a4-acb55394ed68 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1680 microversion: 2.1 time: 0.156672 May 16 20:40:02.110551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 188/375] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:01 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:02.139516 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-37e6526d-296f-4a00-af80-8f1749b3064f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:02.140227 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-37e6526d-296f-4a00-af80-8f1749b3064f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:02.146537 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-37e6526d-296f-4a00-af80-8f1749b3064f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:02.147161 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-37e6526d-296f-4a00-af80-8f1749b3064f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:02.148033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-37e6526d-296f-4a00-af80-8f1749b3064f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:02.148564 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-37e6526d-296f-4a00-af80-8f1749b3064f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:02.154697 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-7a9c7c74-fd74-4bd9-8638-2110670c2866 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:02.162018 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-7a9c7c74-fd74-4bd9-8638-2110670c2866 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1144 microversion: 2.1 time: 0.090787 May 16 20:40:02.162590 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 188/376] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:02 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:02.284943 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-37e6526d-296f-4a00-af80-8f1749b3064f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:02.296482 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-37e6526d-296f-4a00-af80-8f1749b3064f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:02.298014 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-37e6526d-296f-4a00-af80-8f1749b3064f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:02.299181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-37e6526d-296f-4a00-af80-8f1749b3064f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.163875 May 16 20:40:02.299748 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 189/377] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:40:02 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:40:02.338158 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-aa298dce-96e0-486d-a8df-911aedd7c4bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:02.338775 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-aa298dce-96e0-486d-a8df-911aedd7c4bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:02.345536 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-aa298dce-96e0-486d-a8df-911aedd7c4bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:02.346003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-aa298dce-96e0-486d-a8df-911aedd7c4bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:02.346783 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-aa298dce-96e0-486d-a8df-911aedd7c4bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:02.347220 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-aa298dce-96e0-486d-a8df-911aedd7c4bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:02.479560 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-aa298dce-96e0-486d-a8df-911aedd7c4bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:02.487100 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-aa298dce-96e0-486d-a8df-911aedd7c4bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1509 microversion: 2.1 time: 0.152754 May 16 20:40:02.487607 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 189/378] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:02 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:02.640111 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-abd61776-fb22-488c-be57-1c3d6e1b2f89 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:02.641463 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-abd61776-fb22-488c-be57-1c3d6e1b2f89 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:02.652127 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-abd61776-fb22-488c-be57-1c3d6e1b2f89 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:02.653075 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-abd61776-fb22-488c-be57-1c3d6e1b2f89 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:02.653861 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-abd61776-fb22-488c-be57-1c3d6e1b2f89 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:02.654301 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-abd61776-fb22-488c-be57-1c3d6e1b2f89 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:03.013278 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-abd61776-fb22-488c-be57-1c3d6e1b2f89 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:03.020945 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-abd61776-fb22-488c-be57-1c3d6e1b2f89 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1357 microversion: 2.1 time: 0.387467 May 16 20:40:03.021539 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 190/379] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:02 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1357 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:03.131179 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-5b5385cd-04d5-4113-a627-f09022ff04c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:03.132307 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-5b5385cd-04d5-4113-a627-f09022ff04c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:03.141141 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5b5385cd-04d5-4113-a627-f09022ff04c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:03.141596 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5b5385cd-04d5-4113-a627-f09022ff04c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:03.142391 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5b5385cd-04d5-4113-a627-f09022ff04c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:03.142832 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5b5385cd-04d5-4113-a627-f09022ff04c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:03.181900 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-ec2e9a3a-8185-4430-8272-928de15d2c14 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:03.182619 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-ec2e9a3a-8185-4430-8272-928de15d2c14 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:03.205458 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ec2e9a3a-8185-4430-8272-928de15d2c14 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:03.205880 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ec2e9a3a-8185-4430-8272-928de15d2c14 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:03.211120 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ec2e9a3a-8185-4430-8272-928de15d2c14 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:03.211796 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ec2e9a3a-8185-4430-8272-928de15d2c14 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:03.302492 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-ec2e9a3a-8185-4430-8272-928de15d2c14 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:03.310145 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-ec2e9a3a-8185-4430-8272-928de15d2c14 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1144 microversion: 2.1 time: 0.135317 May 16 20:40:03.310682 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 191/380] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:03 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1144 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:03.313813 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-5b5385cd-04d5-4113-a627-f09022ff04c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:03.317527 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-b36b32a5-b227-421d-bcdb-d550705bac7b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:03.318208 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-b36b32a5-b227-421d-bcdb-d550705bac7b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:03.321512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-5b5385cd-04d5-4113-a627-f09022ff04c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1680 microversion: 2.1 time: 0.196983 May 16 20:40:03.322073 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 190/381] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:03 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1680 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:03.324341 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b36b32a5-b227-421d-bcdb-d550705bac7b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:03.324927 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b36b32a5-b227-421d-bcdb-d550705bac7b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:03.325791 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b36b32a5-b227-421d-bcdb-d550705bac7b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:03.326276 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b36b32a5-b227-421d-bcdb-d550705bac7b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:03.467600 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-b36b32a5-b227-421d-bcdb-d550705bac7b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:03.476278 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-b36b32a5-b227-421d-bcdb-d550705bac7b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:03.477809 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-b36b32a5-b227-421d-bcdb-d550705bac7b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:03.478976 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-b36b32a5-b227-421d-bcdb-d550705bac7b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.165049 May 16 20:40:03.479539 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 192/382] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:40:03 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:40:03.507459 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-08eb7818-3dad-4634-90b1-af4056cf60ca tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:03.508514 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-08eb7818-3dad-4634-90b1-af4056cf60ca tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:03.518715 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-08eb7818-3dad-4634-90b1-af4056cf60ca tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:03.519505 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-08eb7818-3dad-4634-90b1-af4056cf60ca tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:03.520902 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-08eb7818-3dad-4634-90b1-af4056cf60ca tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:03.521707 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-08eb7818-3dad-4634-90b1-af4056cf60ca tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:03.684467 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-08eb7818-3dad-4634-90b1-af4056cf60ca tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:03.696251 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-08eb7818-3dad-4634-90b1-af4056cf60ca tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1509 microversion: 2.1 time: 0.194992 May 16 20:40:03.697111 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 191/383] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:03 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:04.039513 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-eba18e30-40e6-468f-894e-4db3375a515d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:04.040407 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-eba18e30-40e6-468f-894e-4db3375a515d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:04.050696 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-eba18e30-40e6-468f-894e-4db3375a515d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:04.051325 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-eba18e30-40e6-468f-894e-4db3375a515d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:04.052523 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-eba18e30-40e6-468f-894e-4db3375a515d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:04.053172 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-eba18e30-40e6-468f-894e-4db3375a515d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:04.253029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-eba18e30-40e6-468f-894e-4db3375a515d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:04.261120 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-eba18e30-40e6-468f-894e-4db3375a515d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1357 microversion: 2.1 time: 0.226876 May 16 20:40:04.261817 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 193/384] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:04 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:40:04.329646 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7b998698-8af6-4bf9-87c1-0ab9dbac1d89 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:04.330566 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-7b998698-8af6-4bf9-87c1-0ab9dbac1d89 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:04.345404 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7b998698-8af6-4bf9-87c1-0ab9dbac1d89 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:04.347104 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-7b76c1e6-b5a3-41b9-8cb7-53591a412648 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:04.347665 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7b998698-8af6-4bf9-87c1-0ab9dbac1d89 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:04.349458 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-7b76c1e6-b5a3-41b9-8cb7-53591a412648 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:04.355603 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7b998698-8af6-4bf9-87c1-0ab9dbac1d89 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:04.361403 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7b998698-8af6-4bf9-87c1-0ab9dbac1d89 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:04.370812 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7b76c1e6-b5a3-41b9-8cb7-53591a412648 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:04.379175 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7b76c1e6-b5a3-41b9-8cb7-53591a412648 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:04.381523 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7b76c1e6-b5a3-41b9-8cb7-53591a412648 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:04.382223 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7b76c1e6-b5a3-41b9-8cb7-53591a412648 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:04.483246 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-7b998698-8af6-4bf9-87c1-0ab9dbac1d89 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:04.498733 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-7b998698-8af6-4bf9-87c1-0ab9dbac1d89 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1192 microversion: 2.1 time: 0.169298 May 16 20:40:04.499990 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 192/385] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:04 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1192 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:04.505323 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-29e0e6de-9c22-4df5-ad3b-8b6b5f00dd2d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:04.506282 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-29e0e6de-9c22-4df5-ad3b-8b6b5f00dd2d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:04.515417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-29e0e6de-9c22-4df5-ad3b-8b6b5f00dd2d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:04.515947 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-29e0e6de-9c22-4df5-ad3b-8b6b5f00dd2d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:04.516939 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-29e0e6de-9c22-4df5-ad3b-8b6b5f00dd2d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:04.517460 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-29e0e6de-9c22-4df5-ad3b-8b6b5f00dd2d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:04.756924 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-7b76c1e6-b5a3-41b9-8cb7-53591a412648 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:04.765784 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-7b76c1e6-b5a3-41b9-8cb7-53591a412648 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1680 microversion: 2.1 time: 0.429770 May 16 20:40:04.766501 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 194/386] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:04 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1680 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:04.771142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-1b7361b2-2d54-4e25-b93b-25b11d498120 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:04.771747 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-1b7361b2-2d54-4e25-b93b-25b11d498120 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:04.780782 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1b7361b2-2d54-4e25-b93b-25b11d498120 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:04.781230 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1b7361b2-2d54-4e25-b93b-25b11d498120 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:04.782005 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1b7361b2-2d54-4e25-b93b-25b11d498120 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:04.782441 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1b7361b2-2d54-4e25-b93b-25b11d498120 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:04.894136 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-29e0e6de-9c22-4df5-ad3b-8b6b5f00dd2d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:04.903585 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-29e0e6de-9c22-4df5-ad3b-8b6b5f00dd2d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:04.905758 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-29e0e6de-9c22-4df5-ad3b-8b6b5f00dd2d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:04.907138 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-29e0e6de-9c22-4df5-ad3b-8b6b5f00dd2d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.405902 May 16 20:40:04.907932 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 193/387] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:40:04 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:40:05.125349 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-1b7361b2-2d54-4e25-b93b-25b11d498120 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:05.140290 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-1b7361b2-2d54-4e25-b93b-25b11d498120 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1509 microversion: 2.1 time: 0.372689 May 16 20:40:05.146485 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 195/388] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:04 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1509 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:05.279265 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-13ebe607-d9e2-469b-9fb0-5785035f76be tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:05.279886 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-13ebe607-d9e2-469b-9fb0-5785035f76be tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:05.287186 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-13ebe607-d9e2-469b-9fb0-5785035f76be tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:05.287855 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-13ebe607-d9e2-469b-9fb0-5785035f76be tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:05.288696 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-13ebe607-d9e2-469b-9fb0-5785035f76be tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:05.289142 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-13ebe607-d9e2-469b-9fb0-5785035f76be tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:05.516972 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-fc1f4ef1-5201-4216-bfda-471ba14bc05a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:05.517581 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-fc1f4ef1-5201-4216-bfda-471ba14bc05a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:05.532149 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-fc1f4ef1-5201-4216-bfda-471ba14bc05a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:05.532643 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-fc1f4ef1-5201-4216-bfda-471ba14bc05a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:05.533692 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-fc1f4ef1-5201-4216-bfda-471ba14bc05a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:05.534268 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-fc1f4ef1-5201-4216-bfda-471ba14bc05a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:05.676518 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-13ebe607-d9e2-469b-9fb0-5785035f76be tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:05.695959 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-13ebe607-d9e2-469b-9fb0-5785035f76be tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1357 microversion: 2.1 time: 0.420890 May 16 20:40:05.705285 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 194/389] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:05 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1357 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:05.705598 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-fc1f4ef1-5201-4216-bfda-471ba14bc05a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:05.713573 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-fc1f4ef1-5201-4216-bfda-471ba14bc05a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1210 microversion: 2.1 time: 0.200450 May 16 20:40:05.716628 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 196/390] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:05 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1210 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:05.783393 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-608c1c8f-7595-4977-8b96-687c3a22f106 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:05.784087 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-608c1c8f-7595-4977-8b96-687c3a22f106 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:05.793324 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-608c1c8f-7595-4977-8b96-687c3a22f106 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:05.794755 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-608c1c8f-7595-4977-8b96-687c3a22f106 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:05.795881 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-608c1c8f-7595-4977-8b96-687c3a22f106 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:05.796500 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-608c1c8f-7595-4977-8b96-687c3a22f106 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:05.877055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-608c1c8f-7595-4977-8b96-687c3a22f106 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:05.890596 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-608c1c8f-7595-4977-8b96-687c3a22f106 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1614 microversion: 2.1 time: 0.111073 May 16 20:40:05.900226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 195/391] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:05 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1614 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:05.926214 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a9e411ed-327b-472c-8747-c8d6493204ce tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:05.927470 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-a9e411ed-327b-472c-8747-c8d6493204ce tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:05.933805 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a9e411ed-327b-472c-8747-c8d6493204ce tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:05.935455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a9e411ed-327b-472c-8747-c8d6493204ce tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:05.937110 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a9e411ed-327b-472c-8747-c8d6493204ce tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:05.937870 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a9e411ed-327b-472c-8747-c8d6493204ce tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:06.163251 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-9d4b1842-a184-4853-9f16-f1da2ccc2690 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:06.163932 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-9d4b1842-a184-4853-9f16-f1da2ccc2690 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:06.171108 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9d4b1842-a184-4853-9f16-f1da2ccc2690 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:06.171534 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9d4b1842-a184-4853-9f16-f1da2ccc2690 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:06.172356 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9d4b1842-a184-4853-9f16-f1da2ccc2690 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:06.172833 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9d4b1842-a184-4853-9f16-f1da2ccc2690 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:06.546760 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a9e411ed-327b-472c-8747-c8d6493204ce tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:06.558123 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a9e411ed-327b-472c-8747-c8d6493204ce tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:06.560249 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a9e411ed-327b-472c-8747-c8d6493204ce tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:06.561875 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-a9e411ed-327b-472c-8747-c8d6493204ce tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.640422 May 16 20:40:06.574699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 197/392] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:40:05 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:40:06.580744 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-3bbd79ec-b8dc-4440-ab17-df0fbb71b2ed req-349518df-d8b9-40ce-91f9-aeb44277f531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36eca126-3242-483f-a941-432265ebaf50", "name": "network-vif-deleted", "tag": "b91c820c-8c4e-4967-8610-a735537dcff4"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:06.584873 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-9d4b1842-a184-4853-9f16-f1da2ccc2690 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:06.597560 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-9d4b1842-a184-4853-9f16-f1da2ccc2690 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1509 microversion: 2.1 time: 0.438032 May 16 20:40:06.599225 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 196/393] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:06 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1509 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:06.599349 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-3bbd79ec-b8dc-4440-ab17-df0fbb71b2ed req-349518df-d8b9-40ce-91f9-aeb44277f531 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:06.599666 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-3bbd79ec-b8dc-4440-ab17-df0fbb71b2ed req-349518df-d8b9-40ce-91f9-aeb44277f531 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:06.611836 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-3bbd79ec-b8dc-4440-ab17-df0fbb71b2ed req-349518df-d8b9-40ce-91f9-aeb44277f531 service nova] Creating event network-vif-deleted:b91c820c-8c4e-4967-8610-a735537dcff4 for instance 36eca126-3242-483f-a941-432265ebaf50 on hv-cinder-77703 May 16 20:40:06.617239 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-3bbd79ec-b8dc-4440-ab17-df0fbb71b2ed req-349518df-d8b9-40ce-91f9-aeb44277f531 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040912 May 16 20:40:06.618359 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 198/394] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:40:06.714027 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-10d3d2be-18f9-4c37-ad74-73ce089c23b0 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:06.715351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-10d3d2be-18f9-4c37-ad74-73ce089c23b0 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:06.733083 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a02b382c-b169-4caa-a41b-414d61c2bbc9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:06.734451 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-a02b382c-b169-4caa-a41b-414d61c2bbc9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:06.742471 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a02b382c-b169-4caa-a41b-414d61c2bbc9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:06.743290 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a02b382c-b169-4caa-a41b-414d61c2bbc9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:06.744679 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-10d3d2be-18f9-4c37-ad74-73ce089c23b0 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:06.745220 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a02b382c-b169-4caa-a41b-414d61c2bbc9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:06.745760 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a02b382c-b169-4caa-a41b-414d61c2bbc9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:06.748682 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-10d3d2be-18f9-4c37-ad74-73ce089c23b0 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:06.749895 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-10d3d2be-18f9-4c37-ad74-73ce089c23b0 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:06.750520 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-10d3d2be-18f9-4c37-ad74-73ce089c23b0 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:06.977655 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a02b382c-b169-4caa-a41b-414d61c2bbc9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:06.986772 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-a02b382c-b169-4caa-a41b-414d61c2bbc9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1266 microversion: 2.1 time: 0.259210 May 16 20:40:06.989895 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 199/395] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:06 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:40:07.002143 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-24449285-9a65-4a4a-85ce-9da579f82ccf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:07.003164 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-24449285-9a65-4a4a-85ce-9da579f82ccf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:07.012264 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-24449285-9a65-4a4a-85ce-9da579f82ccf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:07.016048 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-24449285-9a65-4a4a-85ce-9da579f82ccf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:07.016969 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-24449285-9a65-4a4a-85ce-9da579f82ccf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:07.017419 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-24449285-9a65-4a4a-85ce-9da579f82ccf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:07.044426 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-10d3d2be-18f9-4c37-ad74-73ce089c23b0 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:07.052959 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-10d3d2be-18f9-4c37-ad74-73ce089c23b0 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1357 microversion: 2.1 time: 0.343308 May 16 20:40:07.053802 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 197/396] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:06 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1357 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:07.085658 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-24449285-9a65-4a4a-85ce-9da579f82ccf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:07.093241 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-24449285-9a65-4a4a-85ce-9da579f82ccf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1614 microversion: 2.1 time: 0.102303 May 16 20:40:07.093812 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 200/397] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:06 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1614 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:07.580626 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2be2e995-8dbf-4cc1-b268-b9fe09d8c87b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:07.581589 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-2be2e995-8dbf-4cc1-b268-b9fe09d8c87b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:07.588683 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2be2e995-8dbf-4cc1-b268-b9fe09d8c87b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:07.589132 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2be2e995-8dbf-4cc1-b268-b9fe09d8c87b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:07.589929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2be2e995-8dbf-4cc1-b268-b9fe09d8c87b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:07.590355 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2be2e995-8dbf-4cc1-b268-b9fe09d8c87b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:07.617518 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-236dd546-72aa-4393-a652-eaf29dbb598b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:07.619143 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-236dd546-72aa-4393-a652-eaf29dbb598b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:07.636810 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-236dd546-72aa-4393-a652-eaf29dbb598b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:07.639220 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-236dd546-72aa-4393-a652-eaf29dbb598b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:07.640345 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-236dd546-72aa-4393-a652-eaf29dbb598b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:07.641124 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-236dd546-72aa-4393-a652-eaf29dbb598b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:07.926063 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-2be2e995-8dbf-4cc1-b268-b9fe09d8c87b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:07.938164 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-2be2e995-8dbf-4cc1-b268-b9fe09d8c87b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:07.940259 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-2be2e995-8dbf-4cc1-b268-b9fe09d8c87b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:07.941891 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-2be2e995-8dbf-4cc1-b268-b9fe09d8c87b tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.365150 May 16 20:40:07.943610 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 198/398] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:40:07 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:40:07.951590 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-24f9eed2-fb8a-480d-854a-36ad94bb1060 req-46b5c29a-e140-43be-978d-4cd67cd1e667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8d450f-828f-4002-b649-ff13d14a047c", "name": "network-vif-plugged", "status": "completed", "tag": "6aa491fa-5223-4d44-b9ca-f8811045b0ad"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:07.961362 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-24f9eed2-fb8a-480d-854a-36ad94bb1060 req-46b5c29a-e140-43be-978d-4cd67cd1e667 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:07.962014 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-24f9eed2-fb8a-480d-854a-36ad94bb1060 req-46b5c29a-e140-43be-978d-4cd67cd1e667 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:07.975599 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-24f9eed2-fb8a-480d-854a-36ad94bb1060 req-46b5c29a-e140-43be-978d-4cd67cd1e667 service nova] Creating event network-vif-plugged:6aa491fa-5223-4d44-b9ca-f8811045b0ad for instance 6f8d450f-828f-4002-b649-ff13d14a047c on hv-cinder-77703 May 16 20:40:07.983591 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-24f9eed2-fb8a-480d-854a-36ad94bb1060 req-46b5c29a-e140-43be-978d-4cd67cd1e667 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038393 May 16 20:40:07.984650 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 199/399] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:40:08.006171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-d56ee1e2-2538-4519-b492-badd638b4319 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:08.007497 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-d56ee1e2-2538-4519-b492-badd638b4319 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:08.014032 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d56ee1e2-2538-4519-b492-badd638b4319 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:08.014829 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d56ee1e2-2538-4519-b492-badd638b4319 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:08.015779 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d56ee1e2-2538-4519-b492-badd638b4319 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:08.016361 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d56ee1e2-2538-4519-b492-badd638b4319 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:08.027739 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-236dd546-72aa-4393-a652-eaf29dbb598b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:08.039007 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-236dd546-72aa-4393-a652-eaf29dbb598b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1509 microversion: 2.1 time: 0.427347 May 16 20:40:08.039959 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 201/400] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:07 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1509 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:08.070814 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-47901613-91dd-44b7-b386-f6e4cf3508b8 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:08.071804 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-47901613-91dd-44b7-b386-f6e4cf3508b8 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:08.082724 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-47901613-91dd-44b7-b386-f6e4cf3508b8 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:08.083460 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-47901613-91dd-44b7-b386-f6e4cf3508b8 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:08.084731 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-47901613-91dd-44b7-b386-f6e4cf3508b8 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:08.085292 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-47901613-91dd-44b7-b386-f6e4cf3508b8 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:08.359400 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d56ee1e2-2538-4519-b492-badd638b4319 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:08.367683 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-d56ee1e2-2538-4519-b492-badd638b4319 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1266 microversion: 2.1 time: 0.365779 May 16 20:40:08.372078 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 200/401] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:08 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1266 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:40:08.374214 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-cf0d7b0b-99af-4457-9cfe-8221406f9f2c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:08.374993 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-cf0d7b0b-99af-4457-9cfe-8221406f9f2c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:08.381312 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cf0d7b0b-99af-4457-9cfe-8221406f9f2c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:08.381774 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cf0d7b0b-99af-4457-9cfe-8221406f9f2c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:08.383100 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cf0d7b0b-99af-4457-9cfe-8221406f9f2c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:08.392404 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cf0d7b0b-99af-4457-9cfe-8221406f9f2c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:08.452374 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cf0d7b0b-99af-4457-9cfe-8221406f9f2c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:08.452995 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cf0d7b0b-99af-4457-9cfe-8221406f9f2c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:08.454169 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.objects.instance [None req-cf0d7b0b-99af-4457-9cfe-8221406f9f2c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lazy-loading 'fault' on Instance uuid 36eca126-3242-483f-a941-432265ebaf50 {{(pid=123563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:40:08.462190 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-47901613-91dd-44b7-b386-f6e4cf3508b8 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:08.471066 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-47901613-91dd-44b7-b386-f6e4cf3508b8 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1357 microversion: 2.1 time: 0.404942 May 16 20:40:08.471784 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 202/402] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:08 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1357 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:08.520485 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-cf0d7b0b-99af-4457-9cfe-8221406f9f2c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:08.528680 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-cf0d7b0b-99af-4457-9cfe-8221406f9f2c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 200 len: 1330 microversion: 2.1 time: 0.158828 May 16 20:40:08.538544 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 201/403] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:08 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 1330 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:08.806415 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-9514518d-e3d5-4272-8e04-8d26bdf5d205 req-51376e67-5853-4725-8dcb-7fa40849f4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d149cb81-d021-4785-8e2b-8fb70edb0abb", "tag": "31d1ca32-03e8-4112-856f-1d72165236d2"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:08.814908 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-9514518d-e3d5-4272-8e04-8d26bdf5d205 req-51376e67-5853-4725-8dcb-7fa40849f4a5 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:08.815360 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-9514518d-e3d5-4272-8e04-8d26bdf5d205 req-51376e67-5853-4725-8dcb-7fa40849f4a5 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:08.834100 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-9514518d-e3d5-4272-8e04-8d26bdf5d205 req-51376e67-5853-4725-8dcb-7fa40849f4a5 service nova] Creating event network-changed:31d1ca32-03e8-4112-856f-1d72165236d2 for instance d149cb81-d021-4785-8e2b-8fb70edb0abb on hv-cinder-77703 May 16 20:40:08.844718 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-9514518d-e3d5-4272-8e04-8d26bdf5d205 req-51376e67-5853-4725-8dcb-7fa40849f4a5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041973 May 16 20:40:08.846469 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 203/404] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:40:08.961519 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-903ab925-783f-42a9-9e80-db2f18f8e2b1 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:08.962207 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-903ab925-783f-42a9-9e80-db2f18f8e2b1 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:08.969186 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-903ab925-783f-42a9-9e80-db2f18f8e2b1 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:08.969689 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-903ab925-783f-42a9-9e80-db2f18f8e2b1 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:08.970480 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-903ab925-783f-42a9-9e80-db2f18f8e2b1 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:08.970908 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-903ab925-783f-42a9-9e80-db2f18f8e2b1 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:09.059099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-4788fba6-7a95-4332-b4c5-9840576f3f5a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:09.060116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-4788fba6-7a95-4332-b4c5-9840576f3f5a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:09.071105 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4788fba6-7a95-4332-b4c5-9840576f3f5a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:09.075524 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4788fba6-7a95-4332-b4c5-9840576f3f5a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:09.076713 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4788fba6-7a95-4332-b4c5-9840576f3f5a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:09.078673 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4788fba6-7a95-4332-b4c5-9840576f3f5a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:09.199317 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-903ab925-783f-42a9-9e80-db2f18f8e2b1 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:09.213737 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-903ab925-783f-42a9-9e80-db2f18f8e2b1 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:09.215469 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-903ab925-783f-42a9-9e80-db2f18f8e2b1 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:09.217348 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-903ab925-783f-42a9-9e80-db2f18f8e2b1 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.259916 May 16 20:40:09.219054 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 202/405] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:40:08 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:40:09.354613 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-4788fba6-7a95-4332-b4c5-9840576f3f5a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:09.364091 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-4788fba6-7a95-4332-b4c5-9840576f3f5a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1515 microversion: 2.1 time: 0.310289 May 16 20:40:09.370570 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 204/406] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:09 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1515 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:40:09.388248 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-73d7face-f37b-457c-a9a6-882eee649771 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:09.391534 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-73d7face-f37b-457c-a9a6-882eee649771 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:09.413671 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-73d7face-f37b-457c-a9a6-882eee649771 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:09.414138 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-73d7face-f37b-457c-a9a6-882eee649771 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:09.414928 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-73d7face-f37b-457c-a9a6-882eee649771 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:09.415366 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-73d7face-f37b-457c-a9a6-882eee649771 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:09.488273 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-0de87336-2e25-4c1f-8406-7ce4786b7441 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:09.489543 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-0de87336-2e25-4c1f-8406-7ce4786b7441 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:09.503174 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0de87336-2e25-4c1f-8406-7ce4786b7441 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:09.504101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0de87336-2e25-4c1f-8406-7ce4786b7441 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:09.504950 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0de87336-2e25-4c1f-8406-7ce4786b7441 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:09.505685 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0de87336-2e25-4c1f-8406-7ce4786b7441 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:09.729096 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-73d7face-f37b-457c-a9a6-882eee649771 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:09.736899 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-73d7face-f37b-457c-a9a6-882eee649771 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1266 microversion: 2.1 time: 0.352414 May 16 20:40:09.737781 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 203/407] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:09 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1266 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:09.743100 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-54bc9913-0533-42d9-9e13-a77dbbd49929 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:09.744739 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-54bc9913-0533-42d9-9e13-a77dbbd49929 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:09.751201 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-0de87336-2e25-4c1f-8406-7ce4786b7441 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:09.751384 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-54bc9913-0533-42d9-9e13-a77dbbd49929 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:09.751846 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-54bc9913-0533-42d9-9e13-a77dbbd49929 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:09.752757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-54bc9913-0533-42d9-9e13-a77dbbd49929 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:09.753294 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-54bc9913-0533-42d9-9e13-a77dbbd49929 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:09.759601 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-0de87336-2e25-4c1f-8406-7ce4786b7441 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1357 microversion: 2.1 time: 0.276253 May 16 20:40:09.760386 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 205/408] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:09 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1357 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:40:09.773447 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-54bc9913-0533-42d9-9e13-a77dbbd49929 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] HTTP exception thrown: Instance 36eca126-3242-483f-a941-432265ebaf50 could not be found. May 16 20:40:09.775330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-54bc9913-0533-42d9-9e13-a77dbbd49929 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Request method failure captured: May 16 20:40:09.775330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 HTTP/1.1 May 16 20:40:09.775330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:40:09.775330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:40:09.775330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:40:09.775330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:40:09.775330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:40:09.775330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:40:09.775330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:40:09.775330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:40:09.775330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrXoPH7QRaaUNABjfpjkYuYjuc4YT0JGIT87HUhaS5B5EXLX9gs5SGdefatz8rk10ofLrDlfVl0DHS_o7l3BlYtbJjSH31X6xpm4OYuntjQCYXgO_XFh2HlouaxMKjcOnmFJvaHNJ-XXm3gC4mA2DpJBa428rLJJY3RCeZ4NRvaKM9I May 16 20:40:09.775330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:40:09.775330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:40:09.775330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:40:09.775330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:40:09.775330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:40:09.775330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:40:09.775330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:40:09.775330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:40:09.775330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:40:09.775330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:40:09.776966 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}] May 16 20:40:09.776966 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:40:09.776966 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:40:09.776966 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:40:09.776966 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:40:09.776966 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:40:09.776966 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:40:09.776966 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: b578680e88c741bda2c8e56b2dc9d335 May 16 20:40:09.776966 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:40:09.776966 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: > May 16 20:40:09.776966 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Instance 36eca126-3242-483f-a941-432265ebaf50 could not be found. May 16 20:40:09.776966 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': '36eca126-3242-483f-a941-432265ebaf50'} May 16 20:40:09.777841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:40:09.777841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:40:09.777841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:40:09.777841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:40:09.777841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:40:09.777841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:40:09.777841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:40:09.777841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:40:09.777841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:40:09.777841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:40:09.777841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36eca126-3242-483f-a941-432265ebaf50 could not be found. May 16 20:40:09.777841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:40:09.777841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:40:09.777841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:40:09.777841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:40:09.777841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:40:09.777841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:40:09.777841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:40:09.777841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:40:09.777841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:40:09.779139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:40:09.779139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:40:09.779139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:40:09.779139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:40:09.779139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:40:09.779139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:40:09.779139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:40:09.779139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36eca126-3242-483f-a941-432265ebaf50 could not be found. May 16 20:40:09.779139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:40:09.779139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:40:09.779139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:40:09.779139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:40:09.779139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:40:09.779139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:40:09.779139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:40:09.779139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:40:09.779139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36eca126-3242-483f-a941-432265ebaf50 could not be found. May 16 20:40:09.779139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:40:09.780419 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-54bc9913-0533-42d9-9e13-a77dbbd49929 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Returning 404 to user: Instance 36eca126-3242-483f-a941-432265ebaf50 could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:40:09.780744 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-54bc9913-0533-42d9-9e13-a77dbbd49929 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 404 len: 111 microversion: 2.1 time: 0.041855 May 16 20:40:09.781316 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 204/409] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:09 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:40:09.790089 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-41e88f37-7c44-461f-a329-9c176ca1e002 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '.version_select at 0x7f81b13d05e0>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:09.823173 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-41e88f37-7c44-461f-a329-9c176ca1e002 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-347139245" status: 202 len: 0 microversion: 2.1 time: 0.036897 May 16 20:40:09.827310 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 206/410] 10.222.0.49 () {58 vars in 1217 bytes} [Mon May 16 20:40:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-347139245 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:40:10.017959 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-96628c7c-2a06-48a0-b37a-52c9e2bc8adc req-5e3bf8f7-b723-4f45-bf14-ab61c4bb1c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97c97db-14c0-47b5-b7dc-4a0fab17b32f", "name": "network-vif-plugged", "status": "completed", "tag": "ebd68081-2a96-4732-bf76-3afb6eec8000"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:10.026408 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-96628c7c-2a06-48a0-b37a-52c9e2bc8adc req-5e3bf8f7-b723-4f45-bf14-ab61c4bb1c04 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:10.026843 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-96628c7c-2a06-48a0-b37a-52c9e2bc8adc req-5e3bf8f7-b723-4f45-bf14-ab61c4bb1c04 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:10.037884 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-96628c7c-2a06-48a0-b37a-52c9e2bc8adc req-5e3bf8f7-b723-4f45-bf14-ab61c4bb1c04 service nova] Creating event network-vif-plugged:ebd68081-2a96-4732-bf76-3afb6eec8000 for instance f97c97db-14c0-47b5-b7dc-4a0fab17b32f on hv-cinder-77703 May 16 20:40:10.042811 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-96628c7c-2a06-48a0-b37a-52c9e2bc8adc req-5e3bf8f7-b723-4f45-bf14-ab61c4bb1c04 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028745 May 16 20:40:10.043394 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 205/411] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:40:10.235437 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-fcf662f2-b9b1-4c73-a8c4-3a85fed858e9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:10.236254 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-fcf662f2-b9b1-4c73-a8c4-3a85fed858e9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:10.244027 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-fcf662f2-b9b1-4c73-a8c4-3a85fed858e9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:10.244472 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-fcf662f2-b9b1-4c73-a8c4-3a85fed858e9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:10.245310 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-fcf662f2-b9b1-4c73-a8c4-3a85fed858e9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:10.246417 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-fcf662f2-b9b1-4c73-a8c4-3a85fed858e9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:10.543632 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-fcf662f2-b9b1-4c73-a8c4-3a85fed858e9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:10.554712 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-fcf662f2-b9b1-4c73-a8c4-3a85fed858e9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:10.556674 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-fcf662f2-b9b1-4c73-a8c4-3a85fed858e9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:10.557966 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-fcf662f2-b9b1-4c73-a8c4-3a85fed858e9 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1808 microversion: 2.20 time: 0.326612 May 16 20:40:10.558530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 207/412] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:40:10 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1808 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:40:10.754380 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0389dfc2-d632-4f50-b813-e1e0c4fbbf65 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:10.755084 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0389dfc2-d632-4f50-b813-e1e0c4fbbf65 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:10.764672 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0389dfc2-d632-4f50-b813-e1e0c4fbbf65 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:10.765130 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0389dfc2-d632-4f50-b813-e1e0c4fbbf65 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:10.765958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0389dfc2-d632-4f50-b813-e1e0c4fbbf65 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:10.766388 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0389dfc2-d632-4f50-b813-e1e0c4fbbf65 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:10.780706 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-048a2d15-14fe-42d9-873e-35282088840c tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:10.781642 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-048a2d15-14fe-42d9-873e-35282088840c tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:10.788796 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-048a2d15-14fe-42d9-873e-35282088840c tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:10.789336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-048a2d15-14fe-42d9-873e-35282088840c tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:10.790357 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-048a2d15-14fe-42d9-873e-35282088840c tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:10.790709 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-048a2d15-14fe-42d9-873e-35282088840c tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:10.981128 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-0389dfc2-d632-4f50-b813-e1e0c4fbbf65 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:10.992805 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-048a2d15-14fe-42d9-873e-35282088840c tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:10.993348 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0389dfc2-d632-4f50-b813-e1e0c4fbbf65 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1266 microversion: 2.1 time: 0.242586 May 16 20:40:11.002392 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 206/413] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:10 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:11.002392 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-8b8a32fc-46a7-403d-9970-1eb5a1740e47 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Action: 'create', calling method: .version_select at 0x7f81b12579d0>, body: {"keypair": {"name": "tempest-keypair-772041213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTDUM/s7hI0ODr9IFfGmwkx3hUCx3V8n3KMEtSQM5xfWNDcUq1hi7ppbhFXP7yRt5rKchrnJPsTD0yfw8SiE0Yy+l/O/BTr4yec5eMR+F7ger2u6dKbk6StI7ODVx03sw=="}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:11.002694 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-048a2d15-14fe-42d9-873e-35282088840c tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1357 microversion: 2.1 time: 0.228450 May 16 20:40:11.002694 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 208/414] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:10 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1357 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:40:11.006664 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-b80857de-038a-4586-b781-4238c57d86f9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:11.007454 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-b80857de-038a-4586-b781-4238c57d86f9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:11.015766 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b80857de-038a-4586-b781-4238c57d86f9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:11.016233 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b80857de-038a-4586-b781-4238c57d86f9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:11.017394 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b80857de-038a-4586-b781-4238c57d86f9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:11.018104 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b80857de-038a-4586-b781-4238c57d86f9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:11.028022 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-8b8a32fc-46a7-403d-9970-1eb5a1740e47 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Getting quotas for project 69e39fae43c341798f00e3b48f20d003. Resources: {'key_pairs'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:40:11.032822 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-8b8a32fc-46a7-403d-9970-1eb5a1740e47 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Getting quotas for user 20c57f1318cd4c73b2248b2d02896176 and project 69e39fae43c341798f00e3b48f20d003. Resources: {'key_pairs'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:40:11.056339 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-8b8a32fc-46a7-403d-9970-1eb5a1740e47 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061290 May 16 20:40:11.057318 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 207/415] 10.222.0.49 () {60 vars in 1158 bytes} [Mon May 16 20:40:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:40:11.164617 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.objects.instance [None req-b80857de-038a-4586-b781-4238c57d86f9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lazy-loading 'services' on Instance uuid df423e7b-a5e3-4c9a-adbc-b64a2afd9752 {{(pid=123564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:40:11.285088 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-b80857de-038a-4586-b781-4238c57d86f9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "DELETE /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752/os-volume_attachments/bf3dd65c-238f-49c0-af99-eed77cce339b" status: 202 len: 0 microversion: 2.1 time: 0.282476 May 16 20:40:11.285937 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 209/416] 10.222.0.49 () {58 vars in 1415 bytes} [Mon May 16 20:40:11 2022] DELETE /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752/os-volume_attachments/bf3dd65c-238f-49c0-af99-eed77cce339b => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:40:11.295240 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-aa340963-c53f-4a2d-a928-ca55aba38c38 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:11.296230 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-aa340963-c53f-4a2d-a928-ca55aba38c38 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:11.303758 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-aa340963-c53f-4a2d-a928-ca55aba38c38 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:11.304688 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-aa340963-c53f-4a2d-a928-ca55aba38c38 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:11.305892 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-aa340963-c53f-4a2d-a928-ca55aba38c38 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:11.306779 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-aa340963-c53f-4a2d-a928-ca55aba38c38 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:11.338601 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-aa340963-c53f-4a2d-a928-ca55aba38c38 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048122 May 16 20:40:11.342854 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 208/417] 10.222.0.49 () {58 vars in 1301 bytes} [Mon May 16 20:40:11 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:40:11.577049 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-0c0ac37b-f72b-4586-8b1b-276dc715f0fa tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:11.577746 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-0c0ac37b-f72b-4586-8b1b-276dc715f0fa tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:11.583955 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0c0ac37b-f72b-4586-8b1b-276dc715f0fa tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:11.584407 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0c0ac37b-f72b-4586-8b1b-276dc715f0fa tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:11.585190 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0c0ac37b-f72b-4586-8b1b-276dc715f0fa tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:11.585619 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0c0ac37b-f72b-4586-8b1b-276dc715f0fa tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:11.717486 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-0c0ac37b-f72b-4586-8b1b-276dc715f0fa tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:11.726283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-0c0ac37b-f72b-4586-8b1b-276dc715f0fa tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:11.727757 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-0c0ac37b-f72b-4586-8b1b-276dc715f0fa tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:11.728946 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-0c0ac37b-f72b-4586-8b1b-276dc715f0fa tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1795 microversion: 2.20 time: 0.156202 May 16 20:40:11.729719 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 210/418] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:40:11 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1795 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:40:12.010295 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-40157149-aaab-4690-9424-8cc6c59be202 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:12.011062 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-40157149-aaab-4690-9424-8cc6c59be202 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:12.018222 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-40157149-aaab-4690-9424-8cc6c59be202 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:12.018397 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-ae5e7a2e-646d-4244-a507-c92376db2d1e tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:12.018829 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-40157149-aaab-4690-9424-8cc6c59be202 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:12.018952 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-ae5e7a2e-646d-4244-a507-c92376db2d1e tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:12.019904 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-40157149-aaab-4690-9424-8cc6c59be202 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:12.020544 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-40157149-aaab-4690-9424-8cc6c59be202 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:12.025817 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ae5e7a2e-646d-4244-a507-c92376db2d1e tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:12.026282 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ae5e7a2e-646d-4244-a507-c92376db2d1e tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:12.027030 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ae5e7a2e-646d-4244-a507-c92376db2d1e tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:12.027613 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ae5e7a2e-646d-4244-a507-c92376db2d1e tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:12.226350 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-ae5e7a2e-646d-4244-a507-c92376db2d1e tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:12.230371 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-40157149-aaab-4690-9424-8cc6c59be202 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:12.235743 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-ae5e7a2e-646d-4244-a507-c92376db2d1e tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1357 microversion: 2.1 time: 0.221173 May 16 20:40:12.236678 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 211/419] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:12 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:12.241818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-40157149-aaab-4690-9424-8cc6c59be202 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1266 microversion: 2.1 time: 0.235475 May 16 20:40:12.242465 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 209/420] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:12 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:12.350438 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-932f3ced-167c-42ea-94fd-7158cfc80695 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:12.351426 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-932f3ced-167c-42ea-94fd-7158cfc80695 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:12.357592 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-932f3ced-167c-42ea-94fd-7158cfc80695 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:12.358047 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-932f3ced-167c-42ea-94fd-7158cfc80695 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:12.358827 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-932f3ced-167c-42ea-94fd-7158cfc80695 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:12.359275 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-932f3ced-167c-42ea-94fd-7158cfc80695 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:12.390962 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-932f3ced-167c-42ea-94fd-7158cfc80695 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044717 May 16 20:40:12.391536 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 212/421] 10.222.0.49 () {58 vars in 1301 bytes} [Mon May 16 20:40:12 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:40:12.440476 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-77217d59-c7b9-4916-9314-329b4eb966db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-843872359", "imageRef": "f9826e12-1d0c-4a5a-9616-338520403016", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9d185e7-5065-44be-a31d-7429d98e5dea"}], "security_groups": [{"name": "tempest-securitygroup--1364533349"}], "key_name": "tempest-keypair-772041213", "user_data": "}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:12.540835 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.network.neutron [None req-77217d59-c7b9-4916-9314-329b4eb966db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] validate_networks() for [('e9d185e7-5065-44be-a31d-7429d98e5dea', None, None, None, None, None)] {{(pid=123563) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:40:12.919229 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-77217d59-c7b9-4916-9314-329b4eb966db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Flavor limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:40:12.919683 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-77217d59-c7b9-4916-9314-329b4eb966db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Image limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:40:12.920154 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-77217d59-c7b9-4916-9314-329b4eb966db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Flavor pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:40:12.920918 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-77217d59-c7b9-4916-9314-329b4eb966db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Image pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:40:12.921340 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-77217d59-c7b9-4916-9314-329b4eb966db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:40:12.930422 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-77217d59-c7b9-4916-9314-329b4eb966db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:12.930865 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-77217d59-c7b9-4916-9314-329b4eb966db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:12.931669 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-77217d59-c7b9-4916-9314-329b4eb966db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:12.932128 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-77217d59-c7b9-4916-9314-329b4eb966db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:12.948967 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-77217d59-c7b9-4916-9314-329b4eb966db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Getting quotas for project 69e39fae43c341798f00e3b48f20d003. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:40:12.953140 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-77217d59-c7b9-4916-9314-329b4eb966db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Getting quotas for user 20c57f1318cd4c73b2248b2d02896176 and project 69e39fae43c341798f00e3b48f20d003. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:40:12.964471 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-77217d59-c7b9-4916-9314-329b4eb966db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Going to run 1 instances... {{(pid=123563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:40:12.966758 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-77217d59-c7b9-4916-9314-329b4eb966db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9826e12-1d0c-4a5a-9616-338520403016',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:40:13.021226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-77217d59-c7b9-4916-9314-329b4eb966db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.584984 May 16 20:40:13.021803 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 210/422] 10.222.0.49 () {60 vars in 1146 bytes} [Mon May 16 20:40:12 2022] POST /compute/v2.1/servers => generated 409 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 20:40:13.032951 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-78c7bd07-5a86-4ab6-9b01-a67d6d509f8b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:13.033805 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-78c7bd07-5a86-4ab6-9b01-a67d6d509f8b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:13.093009 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-78c7bd07-5a86-4ab6-9b01-a67d6d509f8b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:13.100666 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-78c7bd07-5a86-4ab6-9b01-a67d6d509f8b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1244 microversion: 2.1 time: 0.072645 May 16 20:40:13.101660 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 213/423] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:13 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1244 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:13.253600 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-67a19179-19f9-40b2-83b0-34477204a242 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:13.254510 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-67a19179-19f9-40b2-83b0-34477204a242 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:13.259403 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-1c8a14b8-75dc-4dce-ae17-58838a965bae tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:13.260182 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-1c8a14b8-75dc-4dce-ae17-58838a965bae tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:13.261784 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-67a19179-19f9-40b2-83b0-34477204a242 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:13.262376 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-67a19179-19f9-40b2-83b0-34477204a242 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:13.263616 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-67a19179-19f9-40b2-83b0-34477204a242 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:13.264103 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-67a19179-19f9-40b2-83b0-34477204a242 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:13.267223 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1c8a14b8-75dc-4dce-ae17-58838a965bae tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:13.267677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1c8a14b8-75dc-4dce-ae17-58838a965bae tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:13.269608 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1c8a14b8-75dc-4dce-ae17-58838a965bae tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:13.269608 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1c8a14b8-75dc-4dce-ae17-58838a965bae tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:13.709462 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-67a19179-19f9-40b2-83b0-34477204a242 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:13.712789 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-1c8a14b8-75dc-4dce-ae17-58838a965bae tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:13.717552 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-67a19179-19f9-40b2-83b0-34477204a242 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1547 microversion: 2.1 time: 0.468437 May 16 20:40:13.718158 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 211/424] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:13 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1547 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:13.721510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-1c8a14b8-75dc-4dce-ae17-58838a965bae tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1266 microversion: 2.1 time: 0.466231 May 16 20:40:13.722581 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 214/425] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:13 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1266 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:13.725177 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-8e460287-b73a-4e2d-b8b4-40301abe5f52 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:13.726172 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-8e460287-b73a-4e2d-b8b4-40301abe5f52 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:13.732397 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8e460287-b73a-4e2d-b8b4-40301abe5f52 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:13.732868 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8e460287-b73a-4e2d-b8b4-40301abe5f52 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:13.733636 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8e460287-b73a-4e2d-b8b4-40301abe5f52 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:13.733819 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-40d323ee-9849-490a-865c-b2da5ece5a01 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:13.734064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8e460287-b73a-4e2d-b8b4-40301abe5f52 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:13.734435 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-40d323ee-9849-490a-865c-b2da5ece5a01 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:13.740736 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-40d323ee-9849-490a-865c-b2da5ece5a01 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:13.741219 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-40d323ee-9849-490a-865c-b2da5ece5a01 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:13.741953 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-40d323ee-9849-490a-865c-b2da5ece5a01 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:13.742389 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-40d323ee-9849-490a-865c-b2da5ece5a01 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:13.762736 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-8e460287-b73a-4e2d-b8b4-40301abe5f52 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043401 May 16 20:40:13.763300 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 212/426] 10.222.0.49 () {58 vars in 1301 bytes} [Mon May 16 20:40:13 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 20:40:13.820136 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-509ff45b-503f-49b5-8128-c9663faa0929 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:13.820659 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-509ff45b-503f-49b5-8128-c9663faa0929 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:13.828609 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-509ff45b-503f-49b5-8128-c9663faa0929 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:13.829059 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-509ff45b-503f-49b5-8128-c9663faa0929 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:13.829818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-509ff45b-503f-49b5-8128-c9663faa0929 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:13.830244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-509ff45b-503f-49b5-8128-c9663faa0929 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:13.857139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-509ff45b-503f-49b5-8128-c9663faa0929 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Going to try to terminate instance {{(pid=123563) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:40:13.869163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-40d323ee-9849-490a-865c-b2da5ece5a01 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:13.877214 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-40d323ee-9849-490a-865c-b2da5ece5a01 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1547 microversion: 2.1 time: 0.146937 May 16 20:40:13.883309 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 215/427] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:13 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:13.892921 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e6ae4ab4-df30-4583-87b7-2b277e5aefa5 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:13.896335 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e6ae4ab4-df30-4583-87b7-2b277e5aefa5 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:13.897027 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-e6ae4ab4-df30-4583-87b7-2b277e5aefa5 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Searching by: {'deleted': False, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14'} {{(pid=123564) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 16 20:40:13.904019 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e6ae4ab4-df30-4583-87b7-2b277e5aefa5 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:13.904639 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e6ae4ab4-df30-4583-87b7-2b277e5aefa5 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:13.905474 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e6ae4ab4-df30-4583-87b7-2b277e5aefa5 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:13.905902 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e6ae4ab4-df30-4583-87b7-2b277e5aefa5 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:13.959717 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-509ff45b-503f-49b5-8128-c9663faa0929 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "DELETE /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 204 len: 0 microversion: 2.1 time: 0.142976 May 16 20:40:13.960811 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 213/428] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:40:13 2022] DELETE /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 20:40:13.971351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-94d174f0-6296-4fe9-8c00-0ffc021e918f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:13.972108 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-94d174f0-6296-4fe9-8c00-0ffc021e918f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:13.982077 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-94d174f0-6296-4fe9-8c00-0ffc021e918f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:13.983198 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-94d174f0-6296-4fe9-8c00-0ffc021e918f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:13.983990 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-94d174f0-6296-4fe9-8c00-0ffc021e918f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:13.984431 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-94d174f0-6296-4fe9-8c00-0ffc021e918f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:14.002178 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.multi_cell_list [None req-e6ae4ab4-df30-4583-87b7-2b277e5aefa5 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123564) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 16 20:40:14.096158 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-e6ae4ab4-df30-4583-87b7-2b277e5aefa5 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.206811 May 16 20:40:14.096802 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 216/429] 10.222.0.49 () {58 vars in 1124 bytes} [Mon May 16 20:40:13 2022] GET /compute/v2.1/servers => generated 342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:40:14.106984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-00f34c6e-c2bd-420c-a88b-3453cba91ac6 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:14.107527 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-00f34c6e-c2bd-420c-a88b-3453cba91ac6 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:14.113395 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-00f34c6e-c2bd-420c-a88b-3453cba91ac6 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:14.113836 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-00f34c6e-c2bd-420c-a88b-3453cba91ac6 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:14.114608 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-00f34c6e-c2bd-420c-a88b-3453cba91ac6 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:14.115038 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-00f34c6e-c2bd-420c-a88b-3453cba91ac6 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:14.137368 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-94d174f0-6296-4fe9-8c00-0ffc021e918f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:14.145212 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-94d174f0-6296-4fe9-8c00-0ffc021e918f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1682 microversion: 2.1 time: 0.179711 May 16 20:40:14.145976 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 214/430] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:13 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:14.150200 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-05c3c2a4-303f-4c6d-8c09-1a111412d1db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:14.150799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-05c3c2a4-303f-4c6d-8c09-1a111412d1db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:14.157099 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-05c3c2a4-303f-4c6d-8c09-1a111412d1db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:14.157540 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-05c3c2a4-303f-4c6d-8c09-1a111412d1db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:14.158322 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-05c3c2a4-303f-4c6d-8c09-1a111412d1db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:14.158753 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-05c3c2a4-303f-4c6d-8c09-1a111412d1db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:14.228025 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-05c3c2a4-303f-4c6d-8c09-1a111412d1db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:14.235677 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-05c3c2a4-303f-4c6d-8c09-1a111412d1db tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1314 microversion: 2.1 time: 0.088883 May 16 20:40:14.236317 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 215/431] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:14 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1314 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:14.265003 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-00f34c6e-c2bd-420c-a88b-3453cba91ac6 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:14.272769 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-00f34c6e-c2bd-420c-a88b-3453cba91ac6 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1547 microversion: 2.1 time: 0.169740 May 16 20:40:14.273376 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 217/432] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:14 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:40:14.743211 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-befc5cf8-f9a0-4f28-819c-75049ddd0a6d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:14.744068 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-befc5cf8-f9a0-4f28-819c-75049ddd0a6d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:14.752110 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-befc5cf8-f9a0-4f28-819c-75049ddd0a6d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:14.752768 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-befc5cf8-f9a0-4f28-819c-75049ddd0a6d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:14.753553 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-befc5cf8-f9a0-4f28-819c-75049ddd0a6d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:14.753982 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-befc5cf8-f9a0-4f28-819c-75049ddd0a6d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:14.902672 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-befc5cf8-f9a0-4f28-819c-75049ddd0a6d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:14.914732 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-befc5cf8-f9a0-4f28-819c-75049ddd0a6d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1266 microversion: 2.1 time: 0.178230 May 16 20:40:14.919339 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 216/433] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:14 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:15.163613 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e4c91672-7026-43a9-aac3-7b32f9af0ede tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:15.164368 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-e4c91672-7026-43a9-aac3-7b32f9af0ede tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:15.172281 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e4c91672-7026-43a9-aac3-7b32f9af0ede tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:15.172871 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e4c91672-7026-43a9-aac3-7b32f9af0ede tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:15.173815 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e4c91672-7026-43a9-aac3-7b32f9af0ede tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:15.174350 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e4c91672-7026-43a9-aac3-7b32f9af0ede tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:15.254272 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-3b0e22ce-4650-483e-a147-ef58b9e955bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:15.254914 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-3b0e22ce-4650-483e-a147-ef58b9e955bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:15.261283 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3b0e22ce-4650-483e-a147-ef58b9e955bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:15.262427 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3b0e22ce-4650-483e-a147-ef58b9e955bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:15.263198 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3b0e22ce-4650-483e-a147-ef58b9e955bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:15.263632 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3b0e22ce-4650-483e-a147-ef58b9e955bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:15.352733 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e4c91672-7026-43a9-aac3-7b32f9af0ede tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:15.355889 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-3b0e22ce-4650-483e-a147-ef58b9e955bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:15.362711 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-e4c91672-7026-43a9-aac3-7b32f9af0ede tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1682 microversion: 2.1 time: 0.203866 May 16 20:40:15.363649 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 218/434] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:15 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1682 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:15.363763 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-3b0e22ce-4650-483e-a147-ef58b9e955bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1314 microversion: 2.1 time: 0.113327 May 16 20:40:15.364561 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 217/435] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:15 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1314 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:40:15.782184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-1dee38b7-10d2-40f1-86e3-d62ef91bb954 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63b942a2-5959-4d39-86b3-e7ff162b03d5"}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:15.783322 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-1dee38b7-10d2-40f1-86e3-d62ef91bb954 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:15.789258 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1dee38b7-10d2-40f1-86e3-d62ef91bb954 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:15.789698 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1dee38b7-10d2-40f1-86e3-d62ef91bb954 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:15.790463 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1dee38b7-10d2-40f1-86e3-d62ef91bb954 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:15.790889 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1dee38b7-10d2-40f1-86e3-d62ef91bb954 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:15.937282 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-f8607485-60df-411e-baa0-71159ef19ff0 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:15.937899 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-f8607485-60df-411e-baa0-71159ef19ff0 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:15.945436 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f8607485-60df-411e-baa0-71159ef19ff0 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:15.945892 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f8607485-60df-411e-baa0-71159ef19ff0 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:15.947367 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f8607485-60df-411e-baa0-71159ef19ff0 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:15.947800 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f8607485-60df-411e-baa0-71159ef19ff0 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:16.051475 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-1dee38b7-10d2-40f1-86e3-d62ef91bb954 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "POST /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273076 May 16 20:40:16.052112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 219/436] 10.222.0.49 () {60 vars in 1322 bytes} [Mon May 16 20:40:15 2022] POST /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:40:16.276803 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f8607485-60df-411e-baa0-71159ef19ff0 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:16.284302 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-f8607485-60df-411e-baa0-71159ef19ff0 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1266 microversion: 2.1 time: 0.351972 May 16 20:40:16.284907 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 218/437] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:15 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1266 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:16.381561 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-df2ced53-52a0-4d5a-9821-e05253adad41 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:16.382264 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-df2ced53-52a0-4d5a-9821-e05253adad41 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:16.390278 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-86a25bbb-1b0b-4936-af3b-6ee52f9badbd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:16.390896 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-86a25bbb-1b0b-4936-af3b-6ee52f9badbd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:16.397328 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-df2ced53-52a0-4d5a-9821-e05253adad41 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:16.397780 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-df2ced53-52a0-4d5a-9821-e05253adad41 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:16.398702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-df2ced53-52a0-4d5a-9821-e05253adad41 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:16.399043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-df2ced53-52a0-4d5a-9821-e05253adad41 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:16.405041 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-86a25bbb-1b0b-4936-af3b-6ee52f9badbd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:16.405492 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-86a25bbb-1b0b-4936-af3b-6ee52f9badbd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:16.406286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-86a25bbb-1b0b-4936-af3b-6ee52f9badbd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:16.406717 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-86a25bbb-1b0b-4936-af3b-6ee52f9badbd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:16.804645 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-df2ced53-52a0-4d5a-9821-e05253adad41 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:16.809352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-86a25bbb-1b0b-4936-af3b-6ee52f9badbd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:16.812203 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-df2ced53-52a0-4d5a-9821-e05253adad41 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1682 microversion: 2.1 time: 0.435609 May 16 20:40:16.813345 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 220/438] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:16 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1682 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:16.818336 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-86a25bbb-1b0b-4936-af3b-6ee52f9badbd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1370 microversion: 2.1 time: 0.431924 May 16 20:40:16.819417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 219/439] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:16 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1370 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:17.237164 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-81afc14f-3b46-48bd-998b-7c0cafa5d1c5 req-acb0c9e8-d9fb-467b-b537-0be7eaf235c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df423e7b-a5e3-4c9a-adbc-b64a2afd9752", "name": "network-vif-deleted", "tag": "666e8c7b-f3e1-4b80-bf22-b473c22db3cd"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:17.245236 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-81afc14f-3b46-48bd-998b-7c0cafa5d1c5 req-acb0c9e8-d9fb-467b-b537-0be7eaf235c6 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:17.245682 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-81afc14f-3b46-48bd-998b-7c0cafa5d1c5 req-acb0c9e8-d9fb-467b-b537-0be7eaf235c6 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:17.257063 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-81afc14f-3b46-48bd-998b-7c0cafa5d1c5 req-acb0c9e8-d9fb-467b-b537-0be7eaf235c6 service nova] Creating event network-vif-deleted:666e8c7b-f3e1-4b80-bf22-b473c22db3cd for instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 on hv-cinder-77703 May 16 20:40:17.262101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-81afc14f-3b46-48bd-998b-7c0cafa5d1c5 req-acb0c9e8-d9fb-467b-b537-0be7eaf235c6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028569 May 16 20:40:17.262926 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 221/440] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:40:17.302033 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-e0b641f7-a5bf-4516-8fcc-7d012c757004 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:17.303513 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-e0b641f7-a5bf-4516-8fcc-7d012c757004 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:17.310246 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e0b641f7-a5bf-4516-8fcc-7d012c757004 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:17.310830 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e0b641f7-a5bf-4516-8fcc-7d012c757004 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:17.311702 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e0b641f7-a5bf-4516-8fcc-7d012c757004 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:17.312262 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e0b641f7-a5bf-4516-8fcc-7d012c757004 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:17.530184 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-e0b641f7-a5bf-4516-8fcc-7d012c757004 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:17.541223 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-e0b641f7-a5bf-4516-8fcc-7d012c757004 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1266 microversion: 2.1 time: 0.243519 May 16 20:40:17.542446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 220/441] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:17 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:17.831529 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-ab27a930-690a-4004-ae01-60c46f24d673 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:17.832929 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-ab27a930-690a-4004-ae01-60c46f24d673 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:17.837121 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-01c93aca-f890-45fe-970b-311d15bc0a76 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:17.837827 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-01c93aca-f890-45fe-970b-311d15bc0a76 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:17.840286 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ab27a930-690a-4004-ae01-60c46f24d673 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:17.840983 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ab27a930-690a-4004-ae01-60c46f24d673 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:17.842089 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ab27a930-690a-4004-ae01-60c46f24d673 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:17.842678 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ab27a930-690a-4004-ae01-60c46f24d673 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:17.844913 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-01c93aca-f890-45fe-970b-311d15bc0a76 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:17.845383 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-01c93aca-f890-45fe-970b-311d15bc0a76 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:17.846681 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-01c93aca-f890-45fe-970b-311d15bc0a76 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:17.847123 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-01c93aca-f890-45fe-970b-311d15bc0a76 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:17.879297 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ab27a930-690a-4004-ae01-60c46f24d673 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:17.879739 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ab27a930-690a-4004-ae01-60c46f24d673 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:17.880372 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.objects.instance [None req-ab27a930-690a-4004-ae01-60c46f24d673 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lazy-loading 'fault' on Instance uuid df423e7b-a5e3-4c9a-adbc-b64a2afd9752 {{(pid=123564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:40:17.963418 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-ab27a930-690a-4004-ae01-60c46f24d673 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:17.973447 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-ab27a930-690a-4004-ae01-60c46f24d673 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 200 len: 1330 microversion: 2.1 time: 0.146932 May 16 20:40:17.976519 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 222/442] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:17 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 1330 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:18.023285 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-01c93aca-f890-45fe-970b-311d15bc0a76 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:18.031147 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-01c93aca-f890-45fe-970b-311d15bc0a76 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1370 microversion: 2.1 time: 0.199590 May 16 20:40:18.031830 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 221/443] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:17 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1370 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:40:18.558663 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-55157996-6e01-435c-9115-4511df61c0b6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:18.559285 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-55157996-6e01-435c-9115-4511df61c0b6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:18.565395 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-55157996-6e01-435c-9115-4511df61c0b6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:18.565844 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-55157996-6e01-435c-9115-4511df61c0b6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:18.566624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-55157996-6e01-435c-9115-4511df61c0b6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:18.567050 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-55157996-6e01-435c-9115-4511df61c0b6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:18.701224 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-55157996-6e01-435c-9115-4511df61c0b6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:18.709302 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-55157996-6e01-435c-9115-4511df61c0b6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1266 microversion: 2.1 time: 0.154562 May 16 20:40:18.709879 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 223/444] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:18 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:18.995056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-07e03161-5f24-4b4d-8430-27da6e6c5af8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:18.996075 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-07e03161-5f24-4b4d-8430-27da6e6c5af8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:19.003574 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-07e03161-5f24-4b4d-8430-27da6e6c5af8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:19.004021 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-07e03161-5f24-4b4d-8430-27da6e6c5af8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:19.004860 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-07e03161-5f24-4b4d-8430-27da6e6c5af8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:19.005287 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-07e03161-5f24-4b4d-8430-27da6e6c5af8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:19.019096 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-07e03161-5f24-4b4d-8430-27da6e6c5af8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] HTTP exception thrown: Instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 could not be found. May 16 20:40:19.020883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-07e03161-5f24-4b4d-8430-27da6e6c5af8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Request method failure captured: May 16 20:40:19.020883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 HTTP/1.1 May 16 20:40:19.020883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:40:19.020883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:40:19.020883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:40:19.020883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:40:19.020883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:40:19.020883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:40:19.020883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:40:19.020883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:40:19.020883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrXoPH7QRaaUNABjfpjkYuYjuc4YT0JGIT87HUhaS5B5EXLX9gs5SGdefatz8rk10ofLrDlfVl0DHS_o7l3BlYtbJjSH31X6xpm4OYuntjQCYXgO_XFh2HlouaxMKjcOnmFJvaHNJ-XXm3gC4mA2DpJBa428rLJJY3RCeZ4NRvaKM9I May 16 20:40:19.020883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:40:19.020883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:40:19.020883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:40:19.020883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:40:19.020883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:40:19.020883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:40:19.020883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:40:19.020883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:40:19.020883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:40:19.020883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:40:19.022430 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}] May 16 20:40:19.022430 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:40:19.022430 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:40:19.022430 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:40:19.022430 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:40:19.022430 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:40:19.022430 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:40:19.022430 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: b578680e88c741bda2c8e56b2dc9d335 May 16 20:40:19.022430 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:40:19.022430 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: > May 16 20:40:19.022430 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 could not be found. May 16 20:40:19.022430 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': 'df423e7b-a5e3-4c9a-adbc-b64a2afd9752'} May 16 20:40:19.023244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:40:19.023244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:40:19.023244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:40:19.023244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:40:19.023244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:40:19.023244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:40:19.023244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:40:19.023244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:40:19.023244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:40:19.023244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:40:19.023244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 could not be found. May 16 20:40:19.023244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:40:19.023244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:40:19.023244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:40:19.023244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:40:19.023244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:40:19.023244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:40:19.023244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:40:19.023244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:40:19.023244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:40:19.024844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:40:19.024844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:40:19.024844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:40:19.024844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:40:19.024844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:40:19.024844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:40:19.024844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:40:19.024844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 could not be found. May 16 20:40:19.024844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:40:19.024844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:40:19.024844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:40:19.024844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:40:19.024844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:40:19.024844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:40:19.024844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:40:19.024844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:40:19.024844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 could not be found. May 16 20:40:19.024844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:40:19.026173 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-07e03161-5f24-4b4d-8430-27da6e6c5af8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Returning 404 to user: Instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:40:19.026173 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-07e03161-5f24-4b4d-8430-27da6e6c5af8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 404 len: 111 microversion: 2.1 time: 0.033961 May 16 20:40:19.026173 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 222/445] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:18 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:40:19.031472 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-0e53bb61-e6ca-4057-89d4-0877d51e0f79 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '.version_select at 0x7f81b1d260d0>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:19.048015 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-a9a5b3a2-d806-4f10-83c2-13c9183da5dc tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:19.048755 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-a9a5b3a2-d806-4f10-83c2-13c9183da5dc tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:19.051983 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-0e53bb61-e6ca-4057-89d4-0877d51e0f79 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-210253230" status: 202 len: 0 microversion: 2.1 time: 0.024534 May 16 20:40:19.052557 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 224/446] 10.222.0.49 () {58 vars in 1217 bytes} [Mon May 16 20:40:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-210253230 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:40:19.055502 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a9a5b3a2-d806-4f10-83c2-13c9183da5dc tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:19.056687 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a9a5b3a2-d806-4f10-83c2-13c9183da5dc tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:19.057140 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a9a5b3a2-d806-4f10-83c2-13c9183da5dc tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:19.057588 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a9a5b3a2-d806-4f10-83c2-13c9183da5dc tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:19.186891 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a9a5b3a2-d806-4f10-83c2-13c9183da5dc tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:19.194872 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-a9a5b3a2-d806-4f10-83c2-13c9183da5dc tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1370 microversion: 2.1 time: 0.150606 May 16 20:40:19.195452 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 223/447] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:19 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:40:19.301602 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-f3518628-6bb2-46a5-875c-88dcedd11570 req-9efa792e-68d6-4f75-9400-9f314c784cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc01c3eb-3650-4295-b423-03ff2d49e945", "tag": "c9ce98a3-3d13-4c84-9fe3-9b633c649795"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:19.311874 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-f3518628-6bb2-46a5-875c-88dcedd11570 req-9efa792e-68d6-4f75-9400-9f314c784cea service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:19.312310 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-f3518628-6bb2-46a5-875c-88dcedd11570 req-9efa792e-68d6-4f75-9400-9f314c784cea service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:19.322488 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-f3518628-6bb2-46a5-875c-88dcedd11570 req-9efa792e-68d6-4f75-9400-9f314c784cea service nova] Creating event network-changed:c9ce98a3-3d13-4c84-9fe3-9b633c649795 for instance dc01c3eb-3650-4295-b423-03ff2d49e945 on hv-cinder-77703 May 16 20:40:19.327574 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-f3518628-6bb2-46a5-875c-88dcedd11570 req-9efa792e-68d6-4f75-9400-9f314c784cea service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030016 May 16 20:40:19.328200 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 225/448] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:40:19.723352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-3006473e-f9b2-41e3-bf1f-8cbac7032b6b req-fc94f80c-b31d-4647-81ab-0701fb8209a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d149cb81-d021-4785-8e2b-8fb70edb0abb", "name": "network-vif-plugged", "status": "completed", "tag": "31d1ca32-03e8-4112-856f-1d72165236d2"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:19.728720 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-5a77f9b1-f1b2-49be-9216-e6f0500a1bfc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:19.729435 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-5a77f9b1-f1b2-49be-9216-e6f0500a1bfc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:19.735709 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-3006473e-f9b2-41e3-bf1f-8cbac7032b6b req-fc94f80c-b31d-4647-81ab-0701fb8209a9 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:19.736370 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-3006473e-f9b2-41e3-bf1f-8cbac7032b6b req-fc94f80c-b31d-4647-81ab-0701fb8209a9 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:19.739404 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5a77f9b1-f1b2-49be-9216-e6f0500a1bfc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:19.740043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5a77f9b1-f1b2-49be-9216-e6f0500a1bfc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:19.741143 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5a77f9b1-f1b2-49be-9216-e6f0500a1bfc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:19.741827 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5a77f9b1-f1b2-49be-9216-e6f0500a1bfc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:19.752586 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-3006473e-f9b2-41e3-bf1f-8cbac7032b6b req-fc94f80c-b31d-4647-81ab-0701fb8209a9 service nova] Creating event network-vif-plugged:31d1ca32-03e8-4112-856f-1d72165236d2 for instance d149cb81-d021-4785-8e2b-8fb70edb0abb on hv-cinder-77703 May 16 20:40:19.758566 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-3006473e-f9b2-41e3-bf1f-8cbac7032b6b req-fc94f80c-b31d-4647-81ab-0701fb8209a9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041605 May 16 20:40:19.759768 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 224/449] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:40:20.027239 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-5a77f9b1-f1b2-49be-9216-e6f0500a1bfc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:20.035217 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-5a77f9b1-f1b2-49be-9216-e6f0500a1bfc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1266 microversion: 2.1 time: 0.312382 May 16 20:40:20.035824 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 226/450] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:19 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:40:20.126577 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-c74618d9-4d59-4d04-8ab6-78cd4b9419aa tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Action: 'create', calling method: .version_select at 0x7f81b1438310>, body: {"keypair": {"name": "tempest-keypair-1485295577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAD+qGsBxSp7+oEuJ5pk/2nkBvzGRweNOFI24xJ/OpEU2OMM5QtynfEALD+BjI3irZF3bDkrCirMATcMaExkkSQ08qKlB5zH5VPmTVDGgZ5iiYdRL1sojM6i8TH3+Hm+xQ=="}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:20.143407 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-c74618d9-4d59-4d04-8ab6-78cd4b9419aa tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Getting quotas for project 2beaab3a72a345d98a9ec4e0ae4686b6. Resources: {'key_pairs'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:40:20.147597 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-c74618d9-4d59-4d04-8ab6-78cd4b9419aa tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Getting quotas for user b578680e88c741bda2c8e56b2dc9d335 and project 2beaab3a72a345d98a9ec4e0ae4686b6. Resources: {'key_pairs'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:40:20.173869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-c74618d9-4d59-4d04-8ab6-78cd4b9419aa tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050854 May 16 20:40:20.175831 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 225/451] 10.222.0.49 () {60 vars in 1158 bytes} [Mon May 16 20:40:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:40:20.212666 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-3868abed-d660-4f19-bfc2-fe6303ee5603 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:20.213274 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-3868abed-d660-4f19-bfc2-fe6303ee5603 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:20.220548 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3868abed-d660-4f19-bfc2-fe6303ee5603 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:20.221255 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3868abed-d660-4f19-bfc2-fe6303ee5603 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:20.222184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3868abed-d660-4f19-bfc2-fe6303ee5603 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:20.222616 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3868abed-d660-4f19-bfc2-fe6303ee5603 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:20.374623 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3868abed-d660-4f19-bfc2-fe6303ee5603 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:20.382436 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-3868abed-d660-4f19-bfc2-fe6303ee5603 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1370 microversion: 2.1 time: 0.173633 May 16 20:40:20.383001 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 227/452] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:20 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:21.053145 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-4a4e0b29-ec46-48f2-bc23-175dcb42fdfc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:21.053890 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-4a4e0b29-ec46-48f2-bc23-175dcb42fdfc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:21.060882 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4a4e0b29-ec46-48f2-bc23-175dcb42fdfc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:21.061336 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4a4e0b29-ec46-48f2-bc23-175dcb42fdfc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:21.062114 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4a4e0b29-ec46-48f2-bc23-175dcb42fdfc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:21.062554 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4a4e0b29-ec46-48f2-bc23-175dcb42fdfc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:21.198841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-4a4e0b29-ec46-48f2-bc23-175dcb42fdfc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:21.206580 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-4a4e0b29-ec46-48f2-bc23-175dcb42fdfc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1266 microversion: 2.1 time: 0.158078 May 16 20:40:21.207160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 226/453] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:21 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:21.399136 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6fcd6301-aa41-448e-a03c-2076e0d95658 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:21.399659 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-6fcd6301-aa41-448e-a03c-2076e0d95658 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:21.406355 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6fcd6301-aa41-448e-a03c-2076e0d95658 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:21.406779 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6fcd6301-aa41-448e-a03c-2076e0d95658 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:21.407547 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6fcd6301-aa41-448e-a03c-2076e0d95658 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:21.407944 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6fcd6301-aa41-448e-a03c-2076e0d95658 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:21.460466 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7b9cee5a-2e01-40f9-aadb-6ce8041104f1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1134494701", "imageRef": "f9826e12-1d0c-4a5a-9616-338520403016", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51755a9b-e432-418d-95c4-023d6854f406"}], "security_groups": [{"name": "tempest-securitygroup--1743823518"}], "key_name": "tempest-keypair-1485295577", "user_data": "}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:21.562592 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6fcd6301-aa41-448e-a03c-2076e0d95658 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:21.571048 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-6fcd6301-aa41-448e-a03c-2076e0d95658 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1370 microversion: 2.1 time: 0.175440 May 16 20:40:21.575052 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 228/454] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:21 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:21.590601 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.network.neutron [None req-7b9cee5a-2e01-40f9-aadb-6ce8041104f1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] validate_networks() for [('51755a9b-e432-418d-95c4-023d6854f406', None, None, None, None, None)] {{(pid=123563) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:40:21.779439 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-8f47f3dc-f030-4781-9a88-b98889708032 req-2f8832ba-a3f5-47e3-a415-751db371d141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc01c3eb-3650-4295-b423-03ff2d49e945", "name": "network-vif-plugged", "status": "completed", "tag": "c9ce98a3-3d13-4c84-9fe3-9b633c649795"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:21.787560 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-8f47f3dc-f030-4781-9a88-b98889708032 req-2f8832ba-a3f5-47e3-a415-751db371d141 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:21.787992 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-8f47f3dc-f030-4781-9a88-b98889708032 req-2f8832ba-a3f5-47e3-a415-751db371d141 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:21.800180 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-8f47f3dc-f030-4781-9a88-b98889708032 req-2f8832ba-a3f5-47e3-a415-751db371d141 service nova] Creating event network-vif-plugged:c9ce98a3-3d13-4c84-9fe3-9b633c649795 for instance dc01c3eb-3650-4295-b423-03ff2d49e945 on hv-cinder-77703 May 16 20:40:21.806654 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-8f47f3dc-f030-4781-9a88-b98889708032 req-2f8832ba-a3f5-47e3-a415-751db371d141 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030779 May 16 20:40:21.807235 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 229/455] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:40:21.963759 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-7b9cee5a-2e01-40f9-aadb-6ce8041104f1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Flavor limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:40:21.964356 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-7b9cee5a-2e01-40f9-aadb-6ce8041104f1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Image limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:40:21.965146 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-7b9cee5a-2e01-40f9-aadb-6ce8041104f1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Flavor pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:40:21.965959 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-7b9cee5a-2e01-40f9-aadb-6ce8041104f1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Image pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:40:21.966240 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-7b9cee5a-2e01-40f9-aadb-6ce8041104f1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:40:21.977092 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7b9cee5a-2e01-40f9-aadb-6ce8041104f1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:21.977616 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7b9cee5a-2e01-40f9-aadb-6ce8041104f1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:21.978504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7b9cee5a-2e01-40f9-aadb-6ce8041104f1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:21.978936 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7b9cee5a-2e01-40f9-aadb-6ce8041104f1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:21.996967 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-7b9cee5a-2e01-40f9-aadb-6ce8041104f1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Getting quotas for project 2beaab3a72a345d98a9ec4e0ae4686b6. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:40:22.001229 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-7b9cee5a-2e01-40f9-aadb-6ce8041104f1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Getting quotas for user b578680e88c741bda2c8e56b2dc9d335 and project 2beaab3a72a345d98a9ec4e0ae4686b6. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:40:22.012230 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-7b9cee5a-2e01-40f9-aadb-6ce8041104f1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Going to run 1 instances... {{(pid=123563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:40:22.014572 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-7b9cee5a-2e01-40f9-aadb-6ce8041104f1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9826e12-1d0c-4a5a-9616-338520403016',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:40:22.063115 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-7b9cee5a-2e01-40f9-aadb-6ce8041104f1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.606947 May 16 20:40:22.063761 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 227/456] 10.222.0.49 () {60 vars in 1146 bytes} [Mon May 16 20:40:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 20:40:22.074314 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-be77f0ec-4380-4692-98f9-a58c79713a5d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:22.075058 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-be77f0ec-4380-4692-98f9-a58c79713a5d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:22.135396 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-be77f0ec-4380-4692-98f9-a58c79713a5d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:22.143360 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-be77f0ec-4380-4692-98f9-a58c79713a5d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31" status: 200 len: 1242 microversion: 2.1 time: 0.073174 May 16 20:40:22.143962 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 230/457] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:22 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:22.223201 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-e8b75dd5-d03f-497e-b12b-06de1c0c425d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:22.223943 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-e8b75dd5-d03f-497e-b12b-06de1c0c425d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:22.231354 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e8b75dd5-d03f-497e-b12b-06de1c0c425d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:22.231863 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e8b75dd5-d03f-497e-b12b-06de1c0c425d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:22.233506 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e8b75dd5-d03f-497e-b12b-06de1c0c425d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:22.234277 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e8b75dd5-d03f-497e-b12b-06de1c0c425d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:22.409529 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-e8b75dd5-d03f-497e-b12b-06de1c0c425d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:22.417451 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-e8b75dd5-d03f-497e-b12b-06de1c0c425d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1454 microversion: 2.1 time: 0.198204 May 16 20:40:22.418023 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 228/458] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:22 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1454 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:22.436092 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-ff59b276-6c20-415d-8723-3242bf2d3a67 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:22.436739 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-ff59b276-6c20-415d-8723-3242bf2d3a67 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:22.446862 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ff59b276-6c20-415d-8723-3242bf2d3a67 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:22.447679 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ff59b276-6c20-415d-8723-3242bf2d3a67 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:22.449668 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ff59b276-6c20-415d-8723-3242bf2d3a67 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:22.450243 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ff59b276-6c20-415d-8723-3242bf2d3a67 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:22.579487 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-ff59b276-6c20-415d-8723-3242bf2d3a67 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:22.587128 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-cd4168cd-7c98-4c5c-a427-730cf05884c6 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:22.587737 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-ff59b276-6c20-415d-8723-3242bf2d3a67 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1454 microversion: 2.1 time: 0.156733 May 16 20:40:22.588271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-cd4168cd-7c98-4c5c-a427-730cf05884c6 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:22.588410 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 231/459] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:22 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:22.594391 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cd4168cd-7c98-4c5c-a427-730cf05884c6 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:22.594844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cd4168cd-7c98-4c5c-a427-730cf05884c6 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:22.595619 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cd4168cd-7c98-4c5c-a427-730cf05884c6 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:22.596060 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cd4168cd-7c98-4c5c-a427-730cf05884c6 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:22.744003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-cd4168cd-7c98-4c5c-a427-730cf05884c6 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:22.755201 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-cd4168cd-7c98-4c5c-a427-730cf05884c6 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1370 microversion: 2.1 time: 0.171916 May 16 20:40:22.765085 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 229/460] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:22 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:23.160327 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-c791b715-2dad-45f1-b818-64ff5f39dd71 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:23.160979 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-c791b715-2dad-45f1-b818-64ff5f39dd71 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:23.167019 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c791b715-2dad-45f1-b818-64ff5f39dd71 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:23.167690 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c791b715-2dad-45f1-b818-64ff5f39dd71 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:23.168577 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c791b715-2dad-45f1-b818-64ff5f39dd71 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:23.169067 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c791b715-2dad-45f1-b818-64ff5f39dd71 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:23.231963 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-c791b715-2dad-45f1-b818-64ff5f39dd71 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:23.239412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-c791b715-2dad-45f1-b818-64ff5f39dd71 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31" status: 200 len: 1294 microversion: 2.1 time: 0.082940 May 16 20:40:23.240104 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 232/461] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:23 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:23.651461 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-c5f138fc-6b88-4eeb-806a-96a538f64b44 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:23.652723 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-c5f138fc-6b88-4eeb-806a-96a538f64b44 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:23.659842 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c5f138fc-6b88-4eeb-806a-96a538f64b44 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:23.660529 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c5f138fc-6b88-4eeb-806a-96a538f64b44 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:23.661314 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c5f138fc-6b88-4eeb-806a-96a538f64b44 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:23.661748 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c5f138fc-6b88-4eeb-806a-96a538f64b44 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:23.772359 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-dcc46bf4-f1b7-4640-93cf-d2cc3933a29e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:23.773042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-dcc46bf4-f1b7-4640-93cf-d2cc3933a29e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:23.779611 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dcc46bf4-f1b7-4640-93cf-d2cc3933a29e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:23.780066 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dcc46bf4-f1b7-4640-93cf-d2cc3933a29e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:23.780884 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dcc46bf4-f1b7-4640-93cf-d2cc3933a29e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:23.781325 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dcc46bf4-f1b7-4640-93cf-d2cc3933a29e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:23.794965 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-c5f138fc-6b88-4eeb-806a-96a538f64b44 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:23.804704 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-c5f138fc-6b88-4eeb-806a-96a538f64b44 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1593 microversion: 2.1 time: 0.156799 May 16 20:40:23.805589 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 230/462] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:23 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1593 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:40:23.917799 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-dcc46bf4-f1b7-4640-93cf-d2cc3933a29e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:23.932196 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-dcc46bf4-f1b7-4640-93cf-d2cc3933a29e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1370 microversion: 2.1 time: 0.163649 May 16 20:40:23.933026 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 233/463] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:23 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:24.257049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-aa0453de-6812-4c04-9b4a-4433778e9b35 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:24.257578 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-aa0453de-6812-4c04-9b4a-4433778e9b35 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:24.263659 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-aa0453de-6812-4c04-9b4a-4433778e9b35 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:24.264117 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-aa0453de-6812-4c04-9b4a-4433778e9b35 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:24.264916 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-aa0453de-6812-4c04-9b4a-4433778e9b35 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:24.265355 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-aa0453de-6812-4c04-9b4a-4433778e9b35 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:24.335932 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-aa0453de-6812-4c04-9b4a-4433778e9b35 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:24.344091 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-aa0453de-6812-4c04-9b4a-4433778e9b35 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31" status: 200 len: 1300 microversion: 2.1 time: 0.091008 May 16 20:40:24.344668 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 231/464] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:24 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:24.950135 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-0a041c60-6558-401b-9f5c-a060c64250de tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:24.951393 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-0a041c60-6558-401b-9f5c-a060c64250de tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:24.957989 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0a041c60-6558-401b-9f5c-a060c64250de tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:24.958626 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0a041c60-6558-401b-9f5c-a060c64250de tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:24.959558 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0a041c60-6558-401b-9f5c-a060c64250de tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:24.960139 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0a041c60-6558-401b-9f5c-a060c64250de tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:25.120078 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-f6018ce8-f605-4a30-9dff-376da74129ec req-c7772743-661d-43e0-a66f-1ff43e3909b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d149cb81-d021-4785-8e2b-8fb70edb0abb", "tag": "31d1ca32-03e8-4112-856f-1d72165236d2"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:25.134816 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-f6018ce8-f605-4a30-9dff-376da74129ec req-c7772743-661d-43e0-a66f-1ff43e3909b6 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:25.137673 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-f6018ce8-f605-4a30-9dff-376da74129ec req-c7772743-661d-43e0-a66f-1ff43e3909b6 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:25.161560 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-f6018ce8-f605-4a30-9dff-376da74129ec req-c7772743-661d-43e0-a66f-1ff43e3909b6 service nova] Creating event network-changed:31d1ca32-03e8-4112-856f-1d72165236d2 for instance d149cb81-d021-4785-8e2b-8fb70edb0abb on hv-cinder-77703 May 16 20:40:25.168999 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-f6018ce8-f605-4a30-9dff-376da74129ec req-c7772743-661d-43e0-a66f-1ff43e3909b6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058024 May 16 20:40:25.170826 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 232/465] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:40:25.234254 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-0a041c60-6558-401b-9f5c-a060c64250de tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:25.245776 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-0a041c60-6558-401b-9f5c-a060c64250de tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1564 microversion: 2.1 time: 0.299383 May 16 20:40:25.247225 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 234/466] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:24 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1564 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:25.264659 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-4b90f81a-7ff3-494f-acef-c9c829e8669a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:25.265535 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-4b90f81a-7ff3-494f-acef-c9c829e8669a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:25.274361 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4b90f81a-7ff3-494f-acef-c9c829e8669a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:25.275122 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4b90f81a-7ff3-494f-acef-c9c829e8669a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:25.276075 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4b90f81a-7ff3-494f-acef-c9c829e8669a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:25.276712 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4b90f81a-7ff3-494f-acef-c9c829e8669a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:25.361647 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-56b1433b-aabb-4211-ad12-1b83eb90da6f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:25.362248 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-56b1433b-aabb-4211-ad12-1b83eb90da6f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:25.371126 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-56b1433b-aabb-4211-ad12-1b83eb90da6f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:25.371825 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-56b1433b-aabb-4211-ad12-1b83eb90da6f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:25.373201 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-56b1433b-aabb-4211-ad12-1b83eb90da6f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:25.374142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-56b1433b-aabb-4211-ad12-1b83eb90da6f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:25.491715 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-56b1433b-aabb-4211-ad12-1b83eb90da6f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:25.500878 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-4b90f81a-7ff3-494f-acef-c9c829e8669a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.241052 May 16 20:40:25.508632 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 233/467] 10.222.0.49 () {58 vars in 1274 bytes} [Mon May 16 20:40:25 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945/os-interface => generated 284 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:40:25.513497 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-56b1433b-aabb-4211-ad12-1b83eb90da6f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31" status: 200 len: 1300 microversion: 2.1 time: 0.155834 May 16 20:40:25.514935 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 235/468] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:25 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 => generated 1300 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:40:26.532936 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-85a59e82-f23d-4d17-a7f1-e544f7f036c2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:26.536707 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-85a59e82-f23d-4d17-a7f1-e544f7f036c2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:26.546211 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-85a59e82-f23d-4d17-a7f1-e544f7f036c2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:26.547063 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-85a59e82-f23d-4d17-a7f1-e544f7f036c2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:26.548086 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-85a59e82-f23d-4d17-a7f1-e544f7f036c2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:26.548841 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-85a59e82-f23d-4d17-a7f1-e544f7f036c2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:26.766995 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-85a59e82-f23d-4d17-a7f1-e544f7f036c2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:26.778167 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-85a59e82-f23d-4d17-a7f1-e544f7f036c2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31" status: 200 len: 1368 microversion: 2.1 time: 0.250865 May 16 20:40:26.779288 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 234/469] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:26 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 => generated 1368 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:40:26.791384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-7e3c8551-b6b0-40ef-b2b7-ad04f3abbcd4 req-c9d270e3-5a39-440a-9420-76c27070bd01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5cee6b8-329b-4d56-b979-3fa246901f31", "tag": "0dfb95f5-6a21-4b0f-9c2a-3d4cea6d3b5e"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:26.808339 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-7e3c8551-b6b0-40ef-b2b7-ad04f3abbcd4 req-c9d270e3-5a39-440a-9420-76c27070bd01 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:26.809185 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-7e3c8551-b6b0-40ef-b2b7-ad04f3abbcd4 req-c9d270e3-5a39-440a-9420-76c27070bd01 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:26.821298 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-7e3c8551-b6b0-40ef-b2b7-ad04f3abbcd4 req-c9d270e3-5a39-440a-9420-76c27070bd01 service nova] Creating event network-changed:0dfb95f5-6a21-4b0f-9c2a-3d4cea6d3b5e for instance c5cee6b8-329b-4d56-b979-3fa246901f31 on hv-cinder-77703 May 16 20:40:26.826289 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-7e3c8551-b6b0-40ef-b2b7-ad04f3abbcd4 req-c9d270e3-5a39-440a-9420-76c27070bd01 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040440 May 16 20:40:26.827125 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 236/470] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:40:27.223386 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-4223f6eb-a1fb-449a-9f7f-84b76c950400 req-46d3ad8d-7647-46fb-85d0-ff7a16916f27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97c97db-14c0-47b5-b7dc-4a0fab17b32f", "tag": "ebd68081-2a96-4732-bf76-3afb6eec8000"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:27.232266 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-4223f6eb-a1fb-449a-9f7f-84b76c950400 req-46d3ad8d-7647-46fb-85d0-ff7a16916f27 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:27.233173 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-4223f6eb-a1fb-449a-9f7f-84b76c950400 req-46d3ad8d-7647-46fb-85d0-ff7a16916f27 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:27.246667 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-4223f6eb-a1fb-449a-9f7f-84b76c950400 req-46d3ad8d-7647-46fb-85d0-ff7a16916f27 service nova] Creating event network-changed:ebd68081-2a96-4732-bf76-3afb6eec8000 for instance f97c97db-14c0-47b5-b7dc-4a0fab17b32f on hv-cinder-77703 May 16 20:40:27.252840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-4223f6eb-a1fb-449a-9f7f-84b76c950400 req-46d3ad8d-7647-46fb-85d0-ff7a16916f27 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032975 May 16 20:40:27.253751 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 235/471] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:40:27.796963 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-bc26e2ac-8995-4d66-8f83-f772e7482007 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:27.798279 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-bc26e2ac-8995-4d66-8f83-f772e7482007 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:27.807098 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bc26e2ac-8995-4d66-8f83-f772e7482007 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:27.808129 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bc26e2ac-8995-4d66-8f83-f772e7482007 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:27.809233 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bc26e2ac-8995-4d66-8f83-f772e7482007 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:27.810306 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bc26e2ac-8995-4d66-8f83-f772e7482007 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:27.969090 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-bc26e2ac-8995-4d66-8f83-f772e7482007 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:27.977335 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-bc26e2ac-8995-4d66-8f83-f772e7482007 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31" status: 200 len: 1368 microversion: 2.1 time: 0.185349 May 16 20:40:27.981092 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 237/472] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:27 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:28.294025 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-b8832cd0-7cf1-42cd-9124-6169cc29eb27 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1467058716"}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:28.294649 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-b8832cd0-7cf1-42cd-9124-6169cc29eb27 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:28.301545 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b8832cd0-7cf1-42cd-9124-6169cc29eb27 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:28.302587 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b8832cd0-7cf1-42cd-9124-6169cc29eb27 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:28.303597 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b8832cd0-7cf1-42cd-9124-6169cc29eb27 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:28.304036 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b8832cd0-7cf1-42cd-9124-6169cc29eb27 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:28.434130 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.network.security_group_api [None req-b8832cd0-7cf1-42cd-9124-6169cc29eb27 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Adding security group 00182a1c-d58c-4057-acdd-fb28ba7844fe to port ebd68081-2a96-4732-bf76-3afb6eec8000 May 16 20:40:28.994456 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-7e4c48bd-7248-4c32-933e-e51059efc5f5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:28.995113 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-7e4c48bd-7248-4c32-933e-e51059efc5f5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:29.005782 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7e4c48bd-7248-4c32-933e-e51059efc5f5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:29.006486 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7e4c48bd-7248-4c32-933e-e51059efc5f5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:29.007563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7e4c48bd-7248-4c32-933e-e51059efc5f5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:29.008148 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7e4c48bd-7248-4c32-933e-e51059efc5f5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:29.018037 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-b8832cd0-7cf1-42cd-9124-6169cc29eb27 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "POST /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f/action" status: 202 len: 0 microversion: 2.1 time: 0.728747 May 16 20:40:29.018774 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 236/473] 10.222.0.49 () {60 vars in 1277 bytes} [Mon May 16 20:40:28 2022] POST /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f/action => generated 0 bytes in 732 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:40:29.027164 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-3052275c-c326-42bb-b3b7-9b6d983d0378 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:29.028177 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-3052275c-c326-42bb-b3b7-9b6d983d0378 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:29.040581 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3052275c-c326-42bb-b3b7-9b6d983d0378 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:29.041038 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3052275c-c326-42bb-b3b7-9b6d983d0378 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:29.043670 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3052275c-c326-42bb-b3b7-9b6d983d0378 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:29.044154 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3052275c-c326-42bb-b3b7-9b6d983d0378 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:29.411777 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-7e4c48bd-7248-4c32-933e-e51059efc5f5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:29.420702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-7e4c48bd-7248-4c32-933e-e51059efc5f5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31" status: 200 len: 1368 microversion: 2.1 time: 0.430216 May 16 20:40:29.421612 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 238/474] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:28 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 => generated 1368 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:40:29.431180 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-ae2bbe4a-b962-4207-98b2-32d231a8447c req-36bfd69c-325b-417d-a6a0-b002aa31d18a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97c97db-14c0-47b5-b7dc-4a0fab17b32f", "tag": "ebd68081-2a96-4732-bf76-3afb6eec8000"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:29.440901 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-ae2bbe4a-b962-4207-98b2-32d231a8447c req-36bfd69c-325b-417d-a6a0-b002aa31d18a service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:29.441603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-ae2bbe4a-b962-4207-98b2-32d231a8447c req-36bfd69c-325b-417d-a6a0-b002aa31d18a service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:29.453919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-ae2bbe4a-b962-4207-98b2-32d231a8447c req-36bfd69c-325b-417d-a6a0-b002aa31d18a service nova] Creating event network-changed:ebd68081-2a96-4732-bf76-3afb6eec8000 for instance f97c97db-14c0-47b5-b7dc-4a0fab17b32f on hv-cinder-77703 May 16 20:40:29.459283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-ae2bbe4a-b962-4207-98b2-32d231a8447c req-36bfd69c-325b-417d-a6a0-b002aa31d18a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035960 May 16 20:40:29.460184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 239/475] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:40:29.466592 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-fe256c15-239e-4cb1-8be1-ae999714cb77 req-e4673ffd-46f1-4ff7-b3b8-9ed55934363a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc01c3eb-3650-4295-b423-03ff2d49e945", "tag": "c9ce98a3-3d13-4c84-9fe3-9b633c649795"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:29.476117 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-fe256c15-239e-4cb1-8be1-ae999714cb77 req-e4673ffd-46f1-4ff7-b3b8-9ed55934363a service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:29.476708 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-fe256c15-239e-4cb1-8be1-ae999714cb77 req-e4673ffd-46f1-4ff7-b3b8-9ed55934363a service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:29.488671 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-fe256c15-239e-4cb1-8be1-ae999714cb77 req-e4673ffd-46f1-4ff7-b3b8-9ed55934363a service nova] Creating event network-changed:c9ce98a3-3d13-4c84-9fe3-9b633c649795 for instance dc01c3eb-3650-4295-b423-03ff2d49e945 on hv-cinder-77703 May 16 20:40:29.495210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-3052275c-c326-42bb-b3b7-9b6d983d0378 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:29.495744 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-fe256c15-239e-4cb1-8be1-ae999714cb77 req-e4673ffd-46f1-4ff7-b3b8-9ed55934363a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033661 May 16 20:40:29.501046 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 240/476] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:40:29.507801 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-3052275c-c326-42bb-b3b7-9b6d983d0378 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1640 microversion: 2.1 time: 0.484648 May 16 20:40:29.509019 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 237/477] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:29 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1640 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:40:30.444781 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-260f7e7b-fd4a-47bb-8f0f-a610eb69cdd2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:30.445982 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-260f7e7b-fd4a-47bb-8f0f-a610eb69cdd2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:30.456616 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-260f7e7b-fd4a-47bb-8f0f-a610eb69cdd2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:30.457358 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-260f7e7b-fd4a-47bb-8f0f-a610eb69cdd2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:30.458623 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-260f7e7b-fd4a-47bb-8f0f-a610eb69cdd2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:30.459343 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-260f7e7b-fd4a-47bb-8f0f-a610eb69cdd2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:30.588776 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-260f7e7b-fd4a-47bb-8f0f-a610eb69cdd2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:30.596728 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-260f7e7b-fd4a-47bb-8f0f-a610eb69cdd2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31" status: 200 len: 1368 microversion: 2.1 time: 0.159636 May 16 20:40:30.597279 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 241/478] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:30 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:40:31.614866 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-f0122d3f-4606-4a82-9f74-95b861460cc9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:31.615422 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-f0122d3f-4606-4a82-9f74-95b861460cc9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:31.622488 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f0122d3f-4606-4a82-9f74-95b861460cc9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:31.622932 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f0122d3f-4606-4a82-9f74-95b861460cc9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:31.623700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f0122d3f-4606-4a82-9f74-95b861460cc9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:31.624128 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f0122d3f-4606-4a82-9f74-95b861460cc9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:31.757371 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f0122d3f-4606-4a82-9f74-95b861460cc9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:31.769499 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-f0122d3f-4606-4a82-9f74-95b861460cc9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31" status: 200 len: 1368 microversion: 2.1 time: 0.158321 May 16 20:40:31.770281 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 238/479] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:31 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:32.794004 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a3f2da5d-2984-4e33-84ed-d8d28eeb7dfc tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:32.795020 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-a3f2da5d-2984-4e33-84ed-d8d28eeb7dfc tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:32.803365 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a3f2da5d-2984-4e33-84ed-d8d28eeb7dfc tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:32.803891 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a3f2da5d-2984-4e33-84ed-d8d28eeb7dfc tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:32.804822 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a3f2da5d-2984-4e33-84ed-d8d28eeb7dfc tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:32.805326 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a3f2da5d-2984-4e33-84ed-d8d28eeb7dfc tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:32.936720 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a3f2da5d-2984-4e33-84ed-d8d28eeb7dfc tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:32.944501 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-a3f2da5d-2984-4e33-84ed-d8d28eeb7dfc tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31" status: 200 len: 1368 microversion: 2.1 time: 0.157095 May 16 20:40:32.945088 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 242/480] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:32 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:33.656882 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-fe63bc53-ec70-476d-90d9-ce5a681b4019 req-5abab44c-1c8b-444a-bc98-6abc0bcffe84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5cee6b8-329b-4d56-b979-3fa246901f31", "name": "network-vif-plugged", "status": "completed", "tag": "0dfb95f5-6a21-4b0f-9c2a-3d4cea6d3b5e"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:33.668078 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-fe63bc53-ec70-476d-90d9-ce5a681b4019 req-5abab44c-1c8b-444a-bc98-6abc0bcffe84 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:33.668873 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-fe63bc53-ec70-476d-90d9-ce5a681b4019 req-5abab44c-1c8b-444a-bc98-6abc0bcffe84 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:33.683623 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-fe63bc53-ec70-476d-90d9-ce5a681b4019 req-5abab44c-1c8b-444a-bc98-6abc0bcffe84 service nova] Creating event network-vif-plugged:0dfb95f5-6a21-4b0f-9c2a-3d4cea6d3b5e for instance c5cee6b8-329b-4d56-b979-3fa246901f31 on hv-cinder-77703 May 16 20:40:33.688859 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-fe63bc53-ec70-476d-90d9-ce5a681b4019 req-5abab44c-1c8b-444a-bc98-6abc0bcffe84 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035738 May 16 20:40:33.689596 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 239/481] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:40:33.963693 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-15ca1ddd-8d49-44c0-a820-dbd3d9de9616 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:33.964372 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-15ca1ddd-8d49-44c0-a820-dbd3d9de9616 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:33.971887 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-15ca1ddd-8d49-44c0-a820-dbd3d9de9616 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:33.972341 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-15ca1ddd-8d49-44c0-a820-dbd3d9de9616 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:33.973155 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-15ca1ddd-8d49-44c0-a820-dbd3d9de9616 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:33.973590 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-15ca1ddd-8d49-44c0-a820-dbd3d9de9616 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:34.117798 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-15ca1ddd-8d49-44c0-a820-dbd3d9de9616 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:34.126989 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-15ca1ddd-8d49-44c0-a820-dbd3d9de9616 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31" status: 200 len: 1368 microversion: 2.1 time: 0.168851 May 16 20:40:34.127559 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 243/482] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:33 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:35.150128 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-870bcb65-fd05-4ae9-a088-403a098c6769 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:35.151290 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-870bcb65-fd05-4ae9-a088-403a098c6769 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:35.162086 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-870bcb65-fd05-4ae9-a088-403a098c6769 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:35.162832 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-870bcb65-fd05-4ae9-a088-403a098c6769 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:35.164094 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-870bcb65-fd05-4ae9-a088-403a098c6769 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:35.164877 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-870bcb65-fd05-4ae9-a088-403a098c6769 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:35.298167 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-870bcb65-fd05-4ae9-a088-403a098c6769 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:35.310445 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-870bcb65-fd05-4ae9-a088-403a098c6769 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31" status: 200 len: 1368 microversion: 2.1 time: 0.167981 May 16 20:40:35.311271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 240/483] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:35 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:36.335464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a2dc39a1-24e3-47de-8bfe-991cda2a0bdb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:36.336505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-a2dc39a1-24e3-47de-8bfe-991cda2a0bdb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:36.345439 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a2dc39a1-24e3-47de-8bfe-991cda2a0bdb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:36.345873 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a2dc39a1-24e3-47de-8bfe-991cda2a0bdb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:36.346679 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a2dc39a1-24e3-47de-8bfe-991cda2a0bdb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:36.347114 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a2dc39a1-24e3-47de-8bfe-991cda2a0bdb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:36.483524 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a2dc39a1-24e3-47de-8bfe-991cda2a0bdb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:40:36.491445 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-a2dc39a1-24e3-47de-8bfe-991cda2a0bdb tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31" status: 200 len: 1558 microversion: 2.1 time: 0.162602 May 16 20:40:36.492016 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 244/484] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:40:36 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:40:36.507797 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2be97923-4892-44de-886d-6fcef2fbf84b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:36.508310 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-2be97923-4892-44de-886d-6fcef2fbf84b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:36.514989 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2be97923-4892-44de-886d-6fcef2fbf84b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:36.515430 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2be97923-4892-44de-886d-6fcef2fbf84b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:36.516199 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2be97923-4892-44de-886d-6fcef2fbf84b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:36.516685 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2be97923-4892-44de-886d-6fcef2fbf84b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:36.594382 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-2be97923-4892-44de-886d-6fcef2fbf84b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090116 May 16 20:40:36.595159 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 241/485] 10.222.0.49 () {58 vars in 1274 bytes} [Mon May 16 20:40:36 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:40:37.774969 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-b35cc26e-dc07-436b-a0a4-c33cc116744b req-18a83043-0f79-42d3-b54e-38f824ed70fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5cee6b8-329b-4d56-b979-3fa246901f31", "tag": "0dfb95f5-6a21-4b0f-9c2a-3d4cea6d3b5e"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:40:37.783813 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-b35cc26e-dc07-436b-a0a4-c33cc116744b req-18a83043-0f79-42d3-b54e-38f824ed70fc service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:37.784246 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-b35cc26e-dc07-436b-a0a4-c33cc116744b req-18a83043-0f79-42d3-b54e-38f824ed70fc service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:37.796828 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-b35cc26e-dc07-436b-a0a4-c33cc116744b req-18a83043-0f79-42d3-b54e-38f824ed70fc service nova] Creating event network-changed:0dfb95f5-6a21-4b0f-9c2a-3d4cea6d3b5e for instance c5cee6b8-329b-4d56-b979-3fa246901f31 on hv-cinder-77703 May 16 20:40:37.802306 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-b35cc26e-dc07-436b-a0a4-c33cc116744b req-18a83043-0f79-42d3-b54e-38f824ed70fc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031322 May 16 20:40:37.803250 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 245/486] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:40:59.863455 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-e96b179d-ab96-4f07-a0cc-4d6eba3b0cea tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:59.864416 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-e96b179d-ab96-4f07-a0cc-4d6eba3b0cea tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:59.871982 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e96b179d-ab96-4f07-a0cc-4d6eba3b0cea tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:59.872448 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e96b179d-ab96-4f07-a0cc-4d6eba3b0cea tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:59.873245 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e96b179d-ab96-4f07-a0cc-4d6eba3b0cea tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:59.873673 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e96b179d-ab96-4f07-a0cc-4d6eba3b0cea tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:59.905143 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-e96b179d-ab96-4f07-a0cc-4d6eba3b0cea tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c/os-volume_attachments/105a7c94-734c-44e3-86c2-d95b74e9e364" status: 200 len: 194 microversion: 2.20 time: 0.049685 May 16 20:40:59.906145 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 242/487] 10.222.0.49 () {60 vars in 1453 bytes} [Mon May 16 20:40:59 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c/os-volume_attachments/105a7c94-734c-44e3-86c2-d95b74e9e364 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 20:40:59.969595 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6d0e0fdb-e1b5-4f78-8b25-a7685a9278ea tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:40:59.970144 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-6d0e0fdb-e1b5-4f78-8b25-a7685a9278ea tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:40:59.976630 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6d0e0fdb-e1b5-4f78-8b25-a7685a9278ea tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:59.977084 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6d0e0fdb-e1b5-4f78-8b25-a7685a9278ea tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:40:59.977858 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6d0e0fdb-e1b5-4f78-8b25-a7685a9278ea tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:40:59.978290 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6d0e0fdb-e1b5-4f78-8b25-a7685a9278ea tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:00.059817 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.objects.instance [None req-6d0e0fdb-e1b5-4f78-8b25-a7685a9278ea tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lazy-loading 'services' on Instance uuid 6f8d450f-828f-4002-b649-ff13d14a047c {{(pid=123564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:41:00.136313 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-6d0e0fdb-e1b5-4f78-8b25-a7685a9278ea tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c/os-volume_attachments/105a7c94-734c-44e3-86c2-d95b74e9e364" status: 202 len: 0 microversion: 2.20 time: 0.171366 May 16 20:41:00.137348 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 246/488] 10.222.0.49 () {60 vars in 1456 bytes} [Mon May 16 20:40:59 2022] DELETE /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c/os-volume_attachments/105a7c94-734c-44e3-86c2-d95b74e9e364 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 20:41:00.146903 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-12550771-ea5b-4126-801d-18e04a7b4c0c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:00.147901 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-12550771-ea5b-4126-801d-18e04a7b4c0c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:00.154022 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-12550771-ea5b-4126-801d-18e04a7b4c0c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:00.154477 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-12550771-ea5b-4126-801d-18e04a7b4c0c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:00.155264 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-12550771-ea5b-4126-801d-18e04a7b4c0c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:00.155706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-12550771-ea5b-4126-801d-18e04a7b4c0c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:00.186350 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-12550771-ea5b-4126-801d-18e04a7b4c0c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043808 May 16 20:41:00.187254 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 243/489] 10.222.0.49 () {60 vars in 1342 bytes} [Mon May 16 20:41:00 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 20:41:01.199427 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-f27bc731-bd00-4056-9973-7a477e4603a5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:01.200463 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-f27bc731-bd00-4056-9973-7a477e4603a5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:01.207631 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f27bc731-bd00-4056-9973-7a477e4603a5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:01.208074 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f27bc731-bd00-4056-9973-7a477e4603a5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:01.208891 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f27bc731-bd00-4056-9973-7a477e4603a5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:01.209324 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f27bc731-bd00-4056-9973-7a477e4603a5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:01.238887 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-f27bc731-bd00-4056-9973-7a477e4603a5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044062 May 16 20:41:01.239444 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 247/490] 10.222.0.49 () {60 vars in 1342 bytes} [Mon May 16 20:41:01 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:01.298762 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-f0308c16-dc0b-47d0-9be1-93f2794fb66a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:01.299290 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-f0308c16-dc0b-47d0-9be1-93f2794fb66a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:01.306304 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f0308c16-dc0b-47d0-9be1-93f2794fb66a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:01.306751 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f0308c16-dc0b-47d0-9be1-93f2794fb66a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:01.307508 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f0308c16-dc0b-47d0-9be1-93f2794fb66a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:01.307941 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f0308c16-dc0b-47d0-9be1-93f2794fb66a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:01.333005 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-f0308c16-dc0b-47d0-9be1-93f2794fb66a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Going to try to terminate instance {{(pid=123563) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:41:01.419441 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-f0308c16-dc0b-47d0-9be1-93f2794fb66a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 204 len: 0 microversion: 2.20 time: 0.124251 May 16 20:41:01.420355 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 244/491] 10.222.0.49 () {60 vars in 1279 bytes} [Mon May 16 20:41:01 2022] DELETE /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 20:41:01.428884 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-231bbd01-819e-45af-ab23-3e7dec2da91f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:01.429491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-231bbd01-819e-45af-ab23-3e7dec2da91f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:01.435600 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-231bbd01-819e-45af-ab23-3e7dec2da91f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:01.436048 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-231bbd01-819e-45af-ab23-3e7dec2da91f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:01.436850 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-231bbd01-819e-45af-ab23-3e7dec2da91f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:01.437279 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-231bbd01-819e-45af-ab23-3e7dec2da91f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:01.464695 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7041104b-faae-42e6-a8e5-c6c8a7f3ff45 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:41:01.465793 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-7041104b-faae-42e6-a8e5-c6c8a7f3ff45 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:01.472181 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7041104b-faae-42e6-a8e5-c6c8a7f3ff45 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:01.472737 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7041104b-faae-42e6-a8e5-c6c8a7f3ff45 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:01.473982 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7041104b-faae-42e6-a8e5-c6c8a7f3ff45 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:01.474386 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7041104b-faae-42e6-a8e5-c6c8a7f3ff45 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:01.550730 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-7041104b-faae-42e6-a8e5-c6c8a7f3ff45 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "POST /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f/action" status: 202 len: 0 microversion: 2.1 time: 0.090339 May 16 20:41:01.551892 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 245/492] 10.222.0.49 () {60 vars in 1277 bytes} [Mon May 16 20:41:01 2022] POST /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:41:01.560314 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-96c128b1-ec12-436a-bae1-6468d94e402c tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:01.561038 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-96c128b1-ec12-436a-bae1-6468d94e402c tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:01.567549 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-96c128b1-ec12-436a-bae1-6468d94e402c tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:01.568017 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-96c128b1-ec12-436a-bae1-6468d94e402c tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:01.568868 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-96c128b1-ec12-436a-bae1-6468d94e402c tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:01.569295 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-96c128b1-ec12-436a-bae1-6468d94e402c tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:01.573510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-231bbd01-819e-45af-ab23-3e7dec2da91f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:01.581875 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-231bbd01-819e-45af-ab23-3e7dec2da91f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:01.583372 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-231bbd01-819e-45af-ab23-3e7dec2da91f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:01.584550 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-231bbd01-819e-45af-ab23-3e7dec2da91f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1723 microversion: 2.20 time: 0.160131 May 16 20:41:01.585118 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 248/493] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:41:01 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:41:01.716927 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-96c128b1-ec12-436a-bae1-6468d94e402c tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:01.728690 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-96c128b1-ec12-436a-bae1-6468d94e402c tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1750 microversion: 2.1 time: 0.172451 May 16 20:41:01.729262 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 246/494] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:01 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:41:02.607465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-5cb922c7-de61-4cc5-851b-4c273f7a214e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:02.608489 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-5cb922c7-de61-4cc5-851b-4c273f7a214e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:02.619228 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5cb922c7-de61-4cc5-851b-4c273f7a214e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:02.619669 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5cb922c7-de61-4cc5-851b-4c273f7a214e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:02.620469 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5cb922c7-de61-4cc5-851b-4c273f7a214e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:02.620917 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5cb922c7-de61-4cc5-851b-4c273f7a214e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:02.746287 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-c83470da-f912-48fd-a07b-7f61ee277df8 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:02.746995 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-c83470da-f912-48fd-a07b-7f61ee277df8 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:02.751525 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-5cb922c7-de61-4cc5-851b-4c273f7a214e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:02.753544 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c83470da-f912-48fd-a07b-7f61ee277df8 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:02.753988 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c83470da-f912-48fd-a07b-7f61ee277df8 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:02.754737 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c83470da-f912-48fd-a07b-7f61ee277df8 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:02.755196 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c83470da-f912-48fd-a07b-7f61ee277df8 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:02.759905 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-5cb922c7-de61-4cc5-851b-4c273f7a214e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:02.761521 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-5cb922c7-de61-4cc5-851b-4c273f7a214e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:02.762707 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-5cb922c7-de61-4cc5-851b-4c273f7a214e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1723 microversion: 2.20 time: 0.161829 May 16 20:41:02.763473 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 249/495] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:41:02 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:41:02.902572 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-c83470da-f912-48fd-a07b-7f61ee277df8 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:02.915251 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-c83470da-f912-48fd-a07b-7f61ee277df8 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1750 microversion: 2.1 time: 0.172616 May 16 20:41:02.915874 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 247/496] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:02 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:41:03.781080 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6cdea46d-23f8-4ebc-98d7-91189ab579ba tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:03.781661 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-6cdea46d-23f8-4ebc-98d7-91189ab579ba tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:03.788504 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6cdea46d-23f8-4ebc-98d7-91189ab579ba tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:03.789225 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6cdea46d-23f8-4ebc-98d7-91189ab579ba tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:03.789996 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6cdea46d-23f8-4ebc-98d7-91189ab579ba tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:03.790554 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6cdea46d-23f8-4ebc-98d7-91189ab579ba tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:03.925846 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6cdea46d-23f8-4ebc-98d7-91189ab579ba tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:03.932665 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-5aa078a8-d88e-4b67-a686-0fc55eec8a4f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:03.933282 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-5aa078a8-d88e-4b67-a686-0fc55eec8a4f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:03.934319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6cdea46d-23f8-4ebc-98d7-91189ab579ba tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:03.935792 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6cdea46d-23f8-4ebc-98d7-91189ab579ba tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:03.936969 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-6cdea46d-23f8-4ebc-98d7-91189ab579ba tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 200 len: 1723 microversion: 2.20 time: 0.159973 May 16 20:41:03.937708 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 250/497] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:41:03 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:41:03.939666 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5aa078a8-d88e-4b67-a686-0fc55eec8a4f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:03.940109 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5aa078a8-d88e-4b67-a686-0fc55eec8a4f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:03.941081 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5aa078a8-d88e-4b67-a686-0fc55eec8a4f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:03.941554 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5aa078a8-d88e-4b67-a686-0fc55eec8a4f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:04.079621 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-5aa078a8-d88e-4b67-a686-0fc55eec8a4f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:04.087732 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-5aa078a8-d88e-4b67-a686-0fc55eec8a4f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1755 microversion: 2.1 time: 0.158934 May 16 20:41:04.088326 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 248/498] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:03 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:41:04.418900 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-2fb31450-a3be-464b-8c67-700bfcf92461 req-3ddfbad6-b73f-4a5d-abb6-eca72461ef3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8d450f-828f-4002-b649-ff13d14a047c", "name": "network-vif-deleted", "tag": "6aa491fa-5223-4d44-b9ca-f8811045b0ad"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:41:04.428999 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-2fb31450-a3be-464b-8c67-700bfcf92461 req-3ddfbad6-b73f-4a5d-abb6-eca72461ef3d service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:04.429461 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-2fb31450-a3be-464b-8c67-700bfcf92461 req-3ddfbad6-b73f-4a5d-abb6-eca72461ef3d service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:04.443377 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-2fb31450-a3be-464b-8c67-700bfcf92461 req-3ddfbad6-b73f-4a5d-abb6-eca72461ef3d service nova] Creating event network-vif-deleted:6aa491fa-5223-4d44-b9ca-f8811045b0ad for instance 6f8d450f-828f-4002-b649-ff13d14a047c on hv-cinder-77703 May 16 20:41:04.448960 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-2fb31450-a3be-464b-8c67-700bfcf92461 req-3ddfbad6-b73f-4a5d-abb6-eca72461ef3d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033839 May 16 20:41:04.450246 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 251/499] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:41:04.955774 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-995aaccf-9040-4ffe-9b77-91f02849125f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:04.956339 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-995aaccf-9040-4ffe-9b77-91f02849125f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:04.962658 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-995aaccf-9040-4ffe-9b77-91f02849125f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:04.963113 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-995aaccf-9040-4ffe-9b77-91f02849125f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:04.963878 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-995aaccf-9040-4ffe-9b77-91f02849125f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:04.964313 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-995aaccf-9040-4ffe-9b77-91f02849125f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:04.978351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-995aaccf-9040-4ffe-9b77-91f02849125f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] HTTP exception thrown: Instance 6f8d450f-828f-4002-b649-ff13d14a047c could not be found. May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-995aaccf-9040-4ffe-9b77-91f02849125f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Request method failure captured: May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c HTTP/1.1 May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrXoLTgXBu2xvGXxniUO9w0EwBsqSDI4EjO3QsEtz1Lg3OjWIY__JEzBqV0Efgt24a4DXjogDT_An7urBtEVrgmqC_7D2xmphytiOKpqdPPWdB9pfIYb86Y_EMxNuj0APgND3mqALDL5Xgaj63HIMbLh1DMQUsecwGEZ_dGFr1JigMc May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Openstack-Nova-Api-Version: 2.20 May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 970ed3a09b3e490399fa39d38e97f9cb May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1446291240 May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:41:04.980028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:41:04.981535 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_970ed3a09b3e490399fa39d38e97f9cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/970ed3a09b3e490399fa39d38e97f9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/970ed3a09b3e490399fa39d38e97f9cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/970ed3a09b3e490399fa39d38e97f9cb"}]}] May 16 20:41:04.981535 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1446291240 May 16 20:41:04.981535 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 970ed3a09b3e490399fa39d38e97f9cb May 16 20:41:04.981535 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1446291240 May 16 20:41:04.981535 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-AttachVolumeShelveTestJSON-1446291240-project May 16 20:41:04.981535 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:41:04.981535 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:41:04.981535 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: de3dd9262fba4830be6c4477628f2061 May 16 20:41:04.981535 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1446291240-project May 16 20:41:04.981535 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: > May 16 20:41:04.981535 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Instance 6f8d450f-828f-4002-b649-ff13d14a047c could not be found. May 16 20:41:04.981535 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': '6f8d450f-828f-4002-b649-ff13d14a047c'} May 16 20:41:04.982390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:41:04.982390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:41:04.982390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:41:04.982390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:41:04.982390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:41:04.982390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:41:04.982390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:41:04.982390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:41:04.982390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:41:04.982390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:41:04.982390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f8d450f-828f-4002-b649-ff13d14a047c could not be found. May 16 20:41:04.982390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:41:04.982390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:41:04.982390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:41:04.982390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:41:04.982390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:41:04.982390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:41:04.982390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:41:04.982390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:41:04.982390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:41:04.983651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:41:04.983651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:41:04.983651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:41:04.983651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:41:04.983651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:41:04.983651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:41:04.983651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:41:04.983651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f8d450f-828f-4002-b649-ff13d14a047c could not be found. May 16 20:41:04.983651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:41:04.983651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:41:04.983651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:41:04.983651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:41:04.983651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:41:04.983651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:41:04.983651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:41:04.983651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:41:04.983651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f8d450f-828f-4002-b649-ff13d14a047c could not be found. May 16 20:41:04.983651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:41:04.984820 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-995aaccf-9040-4ffe-9b77-91f02849125f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Returning 404 to user: Instance 6f8d450f-828f-4002-b649-ff13d14a047c could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:41:04.984820 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-995aaccf-9040-4ffe-9b77-91f02849125f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 404 len: 111 microversion: 2.20 time: 0.030019 May 16 20:41:04.984974 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 249/500] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:41:04 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 20:41:04.991514 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-25f0fbbf-1916-417f-b006-0d07b5adc2cb tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '.version_select at 0x7f81b1181280>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:05.012818 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-25f0fbbf-1916-417f-b006-0d07b5adc2cb tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-326918533" status: 204 len: 0 microversion: 2.20 time: 0.025615 May 16 20:41:05.013618 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 252/501] 10.222.0.49 () {60 vars in 1258 bytes} [Mon May 16 20:41:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-326918533 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 20:41:05.104748 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-da9f9c9c-92f4-4470-81a7-2436a1153b3f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:05.105381 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-da9f9c9c-92f4-4470-81a7-2436a1153b3f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:05.111691 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-da9f9c9c-92f4-4470-81a7-2436a1153b3f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:05.112166 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-da9f9c9c-92f4-4470-81a7-2436a1153b3f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:05.113090 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-da9f9c9c-92f4-4470-81a7-2436a1153b3f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:05.113747 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-da9f9c9c-92f4-4470-81a7-2436a1153b3f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:05.293441 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-da9f9c9c-92f4-4470-81a7-2436a1153b3f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:05.302049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-da9f9c9c-92f4-4470-81a7-2436a1153b3f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1755 microversion: 2.1 time: 0.200787 May 16 20:41:05.302880 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 250/502] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:05 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1755 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:05.905279 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-5b5cc5e0-1993-4f35-84af-f2df001c903e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Action: 'create', calling method: .version_select at 0x7f81b1129820>, body: {"keypair": {"name": "tempest-keypair-1525470111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDedKLPl349c4+1kCG1BGbEn6l9+t785z9LE8kJn3dPkZPBcyXnxVfyTU91c0Y5pRJbMufjaVdtPCPeRtAOUmCD6baQiriDDgl9OK3GDCPiDDjhUeeOa/awsGbczfH4+5A=="}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:41:05.923583 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-5b5cc5e0-1993-4f35-84af-f2df001c903e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Getting quotas for project 970ed3a09b3e490399fa39d38e97f9cb. Resources: {'key_pairs'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:41:05.927864 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-5b5cc5e0-1993-4f35-84af-f2df001c903e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Getting quotas for user de3dd9262fba4830be6c4477628f2061 and project 970ed3a09b3e490399fa39d38e97f9cb. Resources: {'key_pairs'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:41:05.955132 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-5b5cc5e0-1993-4f35-84af-f2df001c903e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.053910 May 16 20:41:05.955804 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 253/503] 10.222.0.49 () {62 vars in 1199 bytes} [Mon May 16 20:41:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 16 20:41:06.319625 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-e4f7ceb4-fd3f-41de-a27b-0d7212daffed tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:06.320232 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-e4f7ceb4-fd3f-41de-a27b-0d7212daffed tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:06.326691 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e4f7ceb4-fd3f-41de-a27b-0d7212daffed tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:06.327141 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e4f7ceb4-fd3f-41de-a27b-0d7212daffed tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:06.327903 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e4f7ceb4-fd3f-41de-a27b-0d7212daffed tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:06.328581 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e4f7ceb4-fd3f-41de-a27b-0d7212daffed tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:06.495478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-e4f7ceb4-fd3f-41de-a27b-0d7212daffed tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:06.503788 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-e4f7ceb4-fd3f-41de-a27b-0d7212daffed tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1755 microversion: 2.1 time: 0.188269 May 16 20:41:06.504364 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 251/504] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:06 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:07.434228 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-cada6a05-1453-4b76-ac15-a7cbcacd2090 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-455378947", "imageRef": "f9826e12-1d0c-4a5a-9616-338520403016", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ecfbded1-d8d9-4f26-a9bd-62198a15a84a"}], "security_groups": [{"name": "tempest-securitygroup--1365432874"}], "key_name": "tempest-keypair-1525470111", "user_data": "}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:41:07.521479 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-efe11423-9258-4f40-bfae-2436623ad620 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:07.522053 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-efe11423-9258-4f40-bfae-2436623ad620 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:07.528661 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-efe11423-9258-4f40-bfae-2436623ad620 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:07.529104 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-efe11423-9258-4f40-bfae-2436623ad620 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:07.529882 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-efe11423-9258-4f40-bfae-2436623ad620 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:07.530504 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-efe11423-9258-4f40-bfae-2436623ad620 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:07.542600 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.network.neutron [None req-cada6a05-1453-4b76-ac15-a7cbcacd2090 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] validate_networks() for [('ecfbded1-d8d9-4f26-a9bd-62198a15a84a', None, None, None, None, None)] {{(pid=123564) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:41:07.758050 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-efe11423-9258-4f40-bfae-2436623ad620 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:07.766375 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-efe11423-9258-4f40-bfae-2436623ad620 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1755 microversion: 2.1 time: 0.248928 May 16 20:41:07.766932 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 252/505] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:07 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1755 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:07.985785 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-cada6a05-1453-4b76-ac15-a7cbcacd2090 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Flavor limits 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:41:07.986214 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-cada6a05-1453-4b76-ac15-a7cbcacd2090 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Image limits 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:41:07.986690 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-cada6a05-1453-4b76-ac15-a7cbcacd2090 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Flavor pref 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:41:07.987103 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-cada6a05-1453-4b76-ac15-a7cbcacd2090 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Image pref 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:41:07.987514 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-cada6a05-1453-4b76-ac15-a7cbcacd2090 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:41:07.997615 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cada6a05-1453-4b76-ac15-a7cbcacd2090 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:07.998056 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cada6a05-1453-4b76-ac15-a7cbcacd2090 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:07.998846 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cada6a05-1453-4b76-ac15-a7cbcacd2090 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:07.999270 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cada6a05-1453-4b76-ac15-a7cbcacd2090 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:08.015492 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-cada6a05-1453-4b76-ac15-a7cbcacd2090 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Getting quotas for project 970ed3a09b3e490399fa39d38e97f9cb. Resources: {'cores', 'ram', 'instances'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:41:08.019794 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-cada6a05-1453-4b76-ac15-a7cbcacd2090 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Getting quotas for user de3dd9262fba4830be6c4477628f2061 and project 970ed3a09b3e490399fa39d38e97f9cb. Resources: {'cores', 'ram', 'instances'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:41:08.032598 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-cada6a05-1453-4b76-ac15-a7cbcacd2090 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Going to run 1 instances... {{(pid=123564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:41:08.034965 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-cada6a05-1453-4b76-ac15-a7cbcacd2090 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9826e12-1d0c-4a5a-9616-338520403016',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:41:08.087561 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-cada6a05-1453-4b76-ac15-a7cbcacd2090 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.657946 May 16 20:41:08.088162 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 254/506] 10.222.0.49 () {62 vars in 1187 bytes} [Mon May 16 20:41:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 16 20:41:08.098375 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-d6447299-f82e-4849-953c-7042842b5a41 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:08.098981 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-d6447299-f82e-4849-953c-7042842b5a41 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:08.151094 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d6447299-f82e-4849-953c-7042842b5a41 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:08.158724 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d6447299-f82e-4849-953c-7042842b5a41 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:08.160232 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d6447299-f82e-4849-953c-7042842b5a41 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:08.161471 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-d6447299-f82e-4849-953c-7042842b5a41 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1281 microversion: 2.20 time: 0.067100 May 16 20:41:08.162033 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 253/507] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:41:08 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1281 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:41:08.787880 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-caa3e2a8-0eea-4cc7-979e-4c42d2bfc88e tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:08.788869 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-caa3e2a8-0eea-4cc7-979e-4c42d2bfc88e tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:08.801236 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-caa3e2a8-0eea-4cc7-979e-4c42d2bfc88e tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:08.802370 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-caa3e2a8-0eea-4cc7-979e-4c42d2bfc88e tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:08.803642 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-caa3e2a8-0eea-4cc7-979e-4c42d2bfc88e tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:08.804363 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-caa3e2a8-0eea-4cc7-979e-4c42d2bfc88e tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:08.958187 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-caa3e2a8-0eea-4cc7-979e-4c42d2bfc88e tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:08.970997 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-caa3e2a8-0eea-4cc7-979e-4c42d2bfc88e tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1755 microversion: 2.1 time: 0.189468 May 16 20:41:08.971791 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 255/508] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:08 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:09.180246 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-c82657b3-14a1-49cd-84ae-1182d0c97d48 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:09.180874 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-c82657b3-14a1-49cd-84ae-1182d0c97d48 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:09.187608 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c82657b3-14a1-49cd-84ae-1182d0c97d48 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:09.188170 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c82657b3-14a1-49cd-84ae-1182d0c97d48 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:09.189069 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c82657b3-14a1-49cd-84ae-1182d0c97d48 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:09.189505 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c82657b3-14a1-49cd-84ae-1182d0c97d48 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:09.259582 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-c82657b3-14a1-49cd-84ae-1182d0c97d48 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:09.268256 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-c82657b3-14a1-49cd-84ae-1182d0c97d48 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:09.269900 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-c82657b3-14a1-49cd-84ae-1182d0c97d48 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:09.271122 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-c82657b3-14a1-49cd-84ae-1182d0c97d48 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1341 microversion: 2.20 time: 0.095243 May 16 20:41:09.272144 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 254/509] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:41:09 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1341 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:41:09.991211 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-36c5f2c3-e726-44d2-abd2-29338ea1742f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:09.991797 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-36c5f2c3-e726-44d2-abd2-29338ea1742f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:09.999048 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-36c5f2c3-e726-44d2-abd2-29338ea1742f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:09.999552 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-36c5f2c3-e726-44d2-abd2-29338ea1742f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:10.000430 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-36c5f2c3-e726-44d2-abd2-29338ea1742f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:10.001039 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-36c5f2c3-e726-44d2-abd2-29338ea1742f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:10.160733 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-36c5f2c3-e726-44d2-abd2-29338ea1742f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:10.169621 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-36c5f2c3-e726-44d2-abd2-29338ea1742f tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1755 microversion: 2.1 time: 0.182336 May 16 20:41:10.170344 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 256/510] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:09 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:10.289528 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-e39683ad-1e38-4d5c-841a-2bb529ae6d18 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:10.290252 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-e39683ad-1e38-4d5c-841a-2bb529ae6d18 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:10.296852 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e39683ad-1e38-4d5c-841a-2bb529ae6d18 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:10.297388 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e39683ad-1e38-4d5c-841a-2bb529ae6d18 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:10.298230 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e39683ad-1e38-4d5c-841a-2bb529ae6d18 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:10.298733 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e39683ad-1e38-4d5c-841a-2bb529ae6d18 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:10.424964 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-e39683ad-1e38-4d5c-841a-2bb529ae6d18 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:10.434096 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-e39683ad-1e38-4d5c-841a-2bb529ae6d18 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:10.435608 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-e39683ad-1e38-4d5c-841a-2bb529ae6d18 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:10.436747 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-e39683ad-1e38-4d5c-841a-2bb529ae6d18 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1407 microversion: 2.20 time: 0.151250 May 16 20:41:10.437464 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 255/511] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:41:10 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:41:10.711370 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-de3e0dfd-0570-4449-b5b1-2c2a6aa4932a req-4903d599-7c90-489b-a6af-28549ac25eaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1718fbf6-1460-443d-9fb4-815bf062c594", "tag": "21b40ca4-40ac-4a3f-9958-fe3007671e02"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:41:10.723014 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-de3e0dfd-0570-4449-b5b1-2c2a6aa4932a req-4903d599-7c90-489b-a6af-28549ac25eaa service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:10.723598 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-de3e0dfd-0570-4449-b5b1-2c2a6aa4932a req-4903d599-7c90-489b-a6af-28549ac25eaa service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:10.736794 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-de3e0dfd-0570-4449-b5b1-2c2a6aa4932a req-4903d599-7c90-489b-a6af-28549ac25eaa service nova] Creating event network-changed:21b40ca4-40ac-4a3f-9958-fe3007671e02 for instance 1718fbf6-1460-443d-9fb4-815bf062c594 on hv-cinder-77703 May 16 20:41:10.744108 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-de3e0dfd-0570-4449-b5b1-2c2a6aa4932a req-4903d599-7c90-489b-a6af-28549ac25eaa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038593 May 16 20:41:10.745215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 257/512] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:41:11.187553 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-70d827b2-6c01-4df8-ab24-cc6af647df32 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:11.188337 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-70d827b2-6c01-4df8-ab24-cc6af647df32 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:11.195105 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-70d827b2-6c01-4df8-ab24-cc6af647df32 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:11.195557 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-70d827b2-6c01-4df8-ab24-cc6af647df32 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:11.196354 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-70d827b2-6c01-4df8-ab24-cc6af647df32 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:11.196820 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-70d827b2-6c01-4df8-ab24-cc6af647df32 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:11.345501 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-70d827b2-6c01-4df8-ab24-cc6af647df32 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:11.353425 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-70d827b2-6c01-4df8-ab24-cc6af647df32 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1755 microversion: 2.1 time: 0.169850 May 16 20:41:11.354107 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 256/513] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:11 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:11.458346 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-d1a12c18-2f82-4ec3-bcc1-6f4f7f4fef06 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:11.458949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-d1a12c18-2f82-4ec3-bcc1-6f4f7f4fef06 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:11.467219 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d1a12c18-2f82-4ec3-bcc1-6f4f7f4fef06 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:11.467668 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d1a12c18-2f82-4ec3-bcc1-6f4f7f4fef06 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:11.468426 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d1a12c18-2f82-4ec3-bcc1-6f4f7f4fef06 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:11.468905 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d1a12c18-2f82-4ec3-bcc1-6f4f7f4fef06 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:11.610498 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-d1a12c18-2f82-4ec3-bcc1-6f4f7f4fef06 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:11.619366 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-d1a12c18-2f82-4ec3-bcc1-6f4f7f4fef06 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:11.620892 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-d1a12c18-2f82-4ec3-bcc1-6f4f7f4fef06 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:11.622185 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-d1a12c18-2f82-4ec3-bcc1-6f4f7f4fef06 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1407 microversion: 2.20 time: 0.170339 May 16 20:41:11.622769 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 258/514] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:41:11 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:41:12.374674 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-8aacb8f4-faa8-4438-aaf7-6a6d3145fba2 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:12.375847 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-8aacb8f4-faa8-4438-aaf7-6a6d3145fba2 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:12.386628 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8aacb8f4-faa8-4438-aaf7-6a6d3145fba2 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:12.387362 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8aacb8f4-faa8-4438-aaf7-6a6d3145fba2 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:12.388676 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8aacb8f4-faa8-4438-aaf7-6a6d3145fba2 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:12.389390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8aacb8f4-faa8-4438-aaf7-6a6d3145fba2 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:12.540643 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-8aacb8f4-faa8-4438-aaf7-6a6d3145fba2 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:12.548836 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-8aacb8f4-faa8-4438-aaf7-6a6d3145fba2 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1755 microversion: 2.1 time: 0.181011 May 16 20:41:12.549415 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 257/515] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:12 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:12.640301 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-bef1f44f-ba17-4912-ab30-84a907633773 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:12.641186 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-bef1f44f-ba17-4912-ab30-84a907633773 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:12.647841 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bef1f44f-ba17-4912-ab30-84a907633773 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:12.648420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bef1f44f-ba17-4912-ab30-84a907633773 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:12.649302 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bef1f44f-ba17-4912-ab30-84a907633773 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:12.649809 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bef1f44f-ba17-4912-ab30-84a907633773 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:12.779550 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-bef1f44f-ba17-4912-ab30-84a907633773 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:12.787878 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-bef1f44f-ba17-4912-ab30-84a907633773 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:12.789420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-bef1f44f-ba17-4912-ab30-84a907633773 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:12.790536 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-bef1f44f-ba17-4912-ab30-84a907633773 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1407 microversion: 2.20 time: 0.154525 May 16 20:41:12.791124 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 259/516] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:41:12 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:41:13.570600 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-20efc3b1-4bbd-484b-b52a-0e0cdea22d11 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:13.571632 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-20efc3b1-4bbd-484b-b52a-0e0cdea22d11 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:13.578953 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-20efc3b1-4bbd-484b-b52a-0e0cdea22d11 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:13.579408 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-20efc3b1-4bbd-484b-b52a-0e0cdea22d11 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:13.580160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-20efc3b1-4bbd-484b-b52a-0e0cdea22d11 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:13.580665 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-20efc3b1-4bbd-484b-b52a-0e0cdea22d11 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:13.739973 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-20efc3b1-4bbd-484b-b52a-0e0cdea22d11 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:13.748824 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-20efc3b1-4bbd-484b-b52a-0e0cdea22d11 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1755 microversion: 2.1 time: 0.185031 May 16 20:41:13.749404 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 258/517] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:13 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:13.809531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a25e8041-9c70-49ee-80e2-173a1b210687 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:13.810168 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-a25e8041-9c70-49ee-80e2-173a1b210687 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:13.817007 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a25e8041-9c70-49ee-80e2-173a1b210687 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:13.817456 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a25e8041-9c70-49ee-80e2-173a1b210687 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:13.818229 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a25e8041-9c70-49ee-80e2-173a1b210687 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:13.818659 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a25e8041-9c70-49ee-80e2-173a1b210687 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:13.948230 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a25e8041-9c70-49ee-80e2-173a1b210687 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:13.957005 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a25e8041-9c70-49ee-80e2-173a1b210687 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:13.958542 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a25e8041-9c70-49ee-80e2-173a1b210687 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:13.959658 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-a25e8041-9c70-49ee-80e2-173a1b210687 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1407 microversion: 2.20 time: 0.154227 May 16 20:41:13.960295 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 260/518] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:41:13 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:41:14.006157 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-800d261f-e349-4e31-80d9-2f320c1e1830 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ca9d73c-53ef-484c-a1c8-1448a967bb83"}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:41:14.007283 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-800d261f-e349-4e31-80d9-2f320c1e1830 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:14.014166 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-800d261f-e349-4e31-80d9-2f320c1e1830 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:14.014619 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-800d261f-e349-4e31-80d9-2f320c1e1830 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:14.015398 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-800d261f-e349-4e31-80d9-2f320c1e1830 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:14.015834 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-800d261f-e349-4e31-80d9-2f320c1e1830 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:14.320935 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-800d261f-e349-4e31-80d9-2f320c1e1830 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "POST /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320746 May 16 20:41:14.321876 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 259/519] 10.222.0.49 () {60 vars in 1322 bytes} [Mon May 16 20:41:13 2022] POST /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:41:14.771792 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-5a17a193-828e-4335-93c4-8bba9d457955 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:14.772310 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-5a17a193-828e-4335-93c4-8bba9d457955 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:14.778287 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5a17a193-828e-4335-93c4-8bba9d457955 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:14.778726 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5a17a193-828e-4335-93c4-8bba9d457955 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:14.779490 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5a17a193-828e-4335-93c4-8bba9d457955 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:14.779923 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5a17a193-828e-4335-93c4-8bba9d457955 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:14.926336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-5a17a193-828e-4335-93c4-8bba9d457955 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:14.934955 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-5a17a193-828e-4335-93c4-8bba9d457955 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1755 microversion: 2.1 time: 0.167505 May 16 20:41:14.935525 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 261/520] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:14 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:14.979101 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-d77ead7d-1403-4f62-b877-730f5d26b92a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:14.979796 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-d77ead7d-1403-4f62-b877-730f5d26b92a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:14.986553 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d77ead7d-1403-4f62-b877-730f5d26b92a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:14.986997 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d77ead7d-1403-4f62-b877-730f5d26b92a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:14.987768 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d77ead7d-1403-4f62-b877-730f5d26b92a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:14.988200 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d77ead7d-1403-4f62-b877-730f5d26b92a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:15.119520 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d77ead7d-1403-4f62-b877-730f5d26b92a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:15.127512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d77ead7d-1403-4f62-b877-730f5d26b92a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:15.129058 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d77ead7d-1403-4f62-b877-730f5d26b92a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:15.130144 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-d77ead7d-1403-4f62-b877-730f5d26b92a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1407 microversion: 2.20 time: 0.156127 May 16 20:41:15.130737 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 260/521] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:41:14 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:41:15.952697 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-92c3ff53-2bf1-4470-9be4-58c95bc6cec3 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:15.953310 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-92c3ff53-2bf1-4470-9be4-58c95bc6cec3 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:15.963834 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-92c3ff53-2bf1-4470-9be4-58c95bc6cec3 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:15.964290 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-92c3ff53-2bf1-4470-9be4-58c95bc6cec3 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:15.965113 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-92c3ff53-2bf1-4470-9be4-58c95bc6cec3 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:15.965579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-92c3ff53-2bf1-4470-9be4-58c95bc6cec3 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:16.107195 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-92c3ff53-2bf1-4470-9be4-58c95bc6cec3 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:16.115211 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-92c3ff53-2bf1-4470-9be4-58c95bc6cec3 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1755 microversion: 2.1 time: 0.166758 May 16 20:41:16.115795 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 262/522] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:15 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:16.149657 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-a1d43c1b-a5f2-4d9e-8b21-eea0e87f3105 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:16.150264 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-a1d43c1b-a5f2-4d9e-8b21-eea0e87f3105 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:16.156966 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a1d43c1b-a5f2-4d9e-8b21-eea0e87f3105 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:16.157492 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a1d43c1b-a5f2-4d9e-8b21-eea0e87f3105 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:16.158208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a1d43c1b-a5f2-4d9e-8b21-eea0e87f3105 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:16.158632 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a1d43c1b-a5f2-4d9e-8b21-eea0e87f3105 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:16.294975 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a1d43c1b-a5f2-4d9e-8b21-eea0e87f3105 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:16.304305 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a1d43c1b-a5f2-4d9e-8b21-eea0e87f3105 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:16.305818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a1d43c1b-a5f2-4d9e-8b21-eea0e87f3105 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:16.307120 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-a1d43c1b-a5f2-4d9e-8b21-eea0e87f3105 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1407 microversion: 2.20 time: 0.161376 May 16 20:41:16.307663 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 261/523] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:41:16 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:41:17.134530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-da332c73-633d-4ed4-9c99-33b4d1ba6432 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:17.135446 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-da332c73-633d-4ed4-9c99-33b4d1ba6432 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:17.142571 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-da332c73-633d-4ed4-9c99-33b4d1ba6432 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:17.142991 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-da332c73-633d-4ed4-9c99-33b4d1ba6432 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:17.143777 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-da332c73-633d-4ed4-9c99-33b4d1ba6432 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:17.144225 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-da332c73-633d-4ed4-9c99-33b4d1ba6432 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:17.280857 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-da332c73-633d-4ed4-9c99-33b4d1ba6432 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:17.289590 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-da332c73-633d-4ed4-9c99-33b4d1ba6432 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1755 microversion: 2.1 time: 0.160178 May 16 20:41:17.290144 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 263/524] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:17 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:17.325237 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-88d1bed3-217a-4c38-b44b-2235a4603e38 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:17.325870 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-88d1bed3-217a-4c38-b44b-2235a4603e38 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:17.332788 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-88d1bed3-217a-4c38-b44b-2235a4603e38 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:17.333252 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-88d1bed3-217a-4c38-b44b-2235a4603e38 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:17.334023 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-88d1bed3-217a-4c38-b44b-2235a4603e38 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:17.334457 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-88d1bed3-217a-4c38-b44b-2235a4603e38 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:17.470775 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-88d1bed3-217a-4c38-b44b-2235a4603e38 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:17.479151 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-88d1bed3-217a-4c38-b44b-2235a4603e38 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:17.480666 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-88d1bed3-217a-4c38-b44b-2235a4603e38 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:17.481776 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-88d1bed3-217a-4c38-b44b-2235a4603e38 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1407 microversion: 2.20 time: 0.160475 May 16 20:41:17.482339 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 262/525] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:41:17 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:41:17.920223 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-c71bd2f6-560b-4274-9951-dcb3f01031f8 req-7fd283f3-9611-499c-a0fb-8fc474fd2ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1718fbf6-1460-443d-9fb4-815bf062c594", "name": "network-vif-plugged", "status": "completed", "tag": "21b40ca4-40ac-4a3f-9958-fe3007671e02"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:41:17.928673 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-c71bd2f6-560b-4274-9951-dcb3f01031f8 req-7fd283f3-9611-499c-a0fb-8fc474fd2ad6 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:17.929119 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-c71bd2f6-560b-4274-9951-dcb3f01031f8 req-7fd283f3-9611-499c-a0fb-8fc474fd2ad6 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:17.940193 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-c71bd2f6-560b-4274-9951-dcb3f01031f8 req-7fd283f3-9611-499c-a0fb-8fc474fd2ad6 service nova] Creating event network-vif-plugged:21b40ca4-40ac-4a3f-9958-fe3007671e02 for instance 1718fbf6-1460-443d-9fb4-815bf062c594 on hv-cinder-77703 May 16 20:41:17.945270 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-c71bd2f6-560b-4274-9951-dcb3f01031f8 req-7fd283f3-9611-499c-a0fb-8fc474fd2ad6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029270 May 16 20:41:17.945841 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 264/526] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:41:18.311741 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-d565e24a-e451-4266-a9eb-9b7276d09739 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:18.312802 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-d565e24a-e451-4266-a9eb-9b7276d09739 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:18.323061 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d565e24a-e451-4266-a9eb-9b7276d09739 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:18.323806 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d565e24a-e451-4266-a9eb-9b7276d09739 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:18.325133 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d565e24a-e451-4266-a9eb-9b7276d09739 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:18.325858 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d565e24a-e451-4266-a9eb-9b7276d09739 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:18.494350 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d565e24a-e451-4266-a9eb-9b7276d09739 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:18.500846 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-62305bac-77f0-4f07-8a4a-8d64f562ad84 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:18.501549 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-62305bac-77f0-4f07-8a4a-8d64f562ad84 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:18.503137 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-d565e24a-e451-4266-a9eb-9b7276d09739 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1755 microversion: 2.1 time: 0.197980 May 16 20:41:18.503951 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 263/527] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:18 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1755 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:18.508469 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-62305bac-77f0-4f07-8a4a-8d64f562ad84 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:18.508932 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-62305bac-77f0-4f07-8a4a-8d64f562ad84 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:18.509723 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-62305bac-77f0-4f07-8a4a-8d64f562ad84 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:18.510283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-62305bac-77f0-4f07-8a4a-8d64f562ad84 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:18.644736 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-62305bac-77f0-4f07-8a4a-8d64f562ad84 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:18.653106 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-62305bac-77f0-4f07-8a4a-8d64f562ad84 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:18.654602 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-62305bac-77f0-4f07-8a4a-8d64f562ad84 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:18.655721 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-62305bac-77f0-4f07-8a4a-8d64f562ad84 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1407 microversion: 2.20 time: 0.160107 May 16 20:41:18.656280 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 265/528] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:41:18 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:41:19.524745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-c0fde9a6-98d9-414e-9a43-e7d8a15f7e9b tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:19.525716 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-c0fde9a6-98d9-414e-9a43-e7d8a15f7e9b tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:19.536747 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c0fde9a6-98d9-414e-9a43-e7d8a15f7e9b tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:19.537513 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c0fde9a6-98d9-414e-9a43-e7d8a15f7e9b tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:19.538792 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c0fde9a6-98d9-414e-9a43-e7d8a15f7e9b tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:19.539519 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c0fde9a6-98d9-414e-9a43-e7d8a15f7e9b tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:19.673143 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-1ceb0f20-ccd1-40ee-8c7b-d345969b24e5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:19.673750 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-1ceb0f20-ccd1-40ee-8c7b-d345969b24e5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:19.680965 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1ceb0f20-ccd1-40ee-8c7b-d345969b24e5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:19.681409 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1ceb0f20-ccd1-40ee-8c7b-d345969b24e5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:19.682177 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1ceb0f20-ccd1-40ee-8c7b-d345969b24e5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:19.682606 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1ceb0f20-ccd1-40ee-8c7b-d345969b24e5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:19.686358 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-c0fde9a6-98d9-414e-9a43-e7d8a15f7e9b tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:19.694430 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-c0fde9a6-98d9-414e-9a43-e7d8a15f7e9b tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1755 microversion: 2.1 time: 0.176315 May 16 20:41:19.695014 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 264/529] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:19 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:19.828500 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-1ceb0f20-ccd1-40ee-8c7b-d345969b24e5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:19.836961 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-1ceb0f20-ccd1-40ee-8c7b-d345969b24e5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:19.838540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-1ceb0f20-ccd1-40ee-8c7b-d345969b24e5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:19.839737 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-1ceb0f20-ccd1-40ee-8c7b-d345969b24e5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1599 microversion: 2.20 time: 0.170564 May 16 20:41:19.840306 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 266/530] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:41:19 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:41:19.856942 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-9269da6e-669d-4225-88c7-b20007dc7b8a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:19.857441 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-9269da6e-669d-4225-88c7-b20007dc7b8a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:19.863392 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9269da6e-669d-4225-88c7-b20007dc7b8a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:19.864041 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9269da6e-669d-4225-88c7-b20007dc7b8a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:19.864838 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9269da6e-669d-4225-88c7-b20007dc7b8a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:19.865356 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9269da6e-669d-4225-88c7-b20007dc7b8a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:19.945050 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-9269da6e-669d-4225-88c7-b20007dc7b8a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092018 May 16 20:41:19.945659 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 265/531] 10.222.0.49 () {60 vars in 1315 bytes} [Mon May 16 20:41:19 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 20:41:20.711550 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-280cb3bd-19a6-48d9-b5c3-192568073c9d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:20.712257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-280cb3bd-19a6-48d9-b5c3-192568073c9d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:20.720023 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-280cb3bd-19a6-48d9-b5c3-192568073c9d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:20.720581 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-280cb3bd-19a6-48d9-b5c3-192568073c9d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:20.721838 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-280cb3bd-19a6-48d9-b5c3-192568073c9d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:20.721989 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-280cb3bd-19a6-48d9-b5c3-192568073c9d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:20.942318 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-280cb3bd-19a6-48d9-b5c3-192568073c9d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:20.945540 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-044ee9ae-882f-400f-b34f-7e39eacb354b req-afe35436-a0be-409a-9262-465e5c91e99b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1718fbf6-1460-443d-9fb4-815bf062c594", "tag": "21b40ca4-40ac-4a3f-9958-fe3007671e02"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:41:20.951143 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-280cb3bd-19a6-48d9-b5c3-192568073c9d tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1758 microversion: 2.1 time: 0.243469 May 16 20:41:20.951728 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 267/532] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:20 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1758 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:20.954518 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-044ee9ae-882f-400f-b34f-7e39eacb354b req-afe35436-a0be-409a-9262-465e5c91e99b service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:20.955305 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-044ee9ae-882f-400f-b34f-7e39eacb354b req-afe35436-a0be-409a-9262-465e5c91e99b service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:20.967453 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-044ee9ae-882f-400f-b34f-7e39eacb354b req-afe35436-a0be-409a-9262-465e5c91e99b service nova] Creating event network-changed:21b40ca4-40ac-4a3f-9958-fe3007671e02 for instance 1718fbf6-1460-443d-9fb4-815bf062c594 on hv-cinder-77703 May 16 20:41:20.972562 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-044ee9ae-882f-400f-b34f-7e39eacb354b req-afe35436-a0be-409a-9262-465e5c91e99b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031235 May 16 20:41:20.973229 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 266/533] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:41:21.818487 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e2497297-e290-4832-a821-243d30c015a9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:41:21.819445 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-e2497297-e290-4832-a821-243d30c015a9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:21.825971 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e2497297-e290-4832-a821-243d30c015a9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:21.826423 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e2497297-e290-4832-a821-243d30c015a9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:21.827201 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e2497297-e290-4832-a821-243d30c015a9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:21.827637 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e2497297-e290-4832-a821-243d30c015a9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:21.850003 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.objects.instance [None req-e2497297-e290-4832-a821-243d30c015a9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lazy-loading 'flavor' on Instance uuid dc01c3eb-3650-4295-b423-03ff2d49e945 {{(pid=123564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:41:22.012771 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-e2497297-e290-4832-a821-243d30c015a9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "POST /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945/action" status: 200 len: 32 microversion: 2.1 time: 0.198230 May 16 20:41:22.013345 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 268/534] 10.222.0.49 () {60 vars in 1277 bytes} [Mon May 16 20:41:21 2022] POST /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 20:41:22.023324 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-e804756c-604b-4fc9-a967-c9f08ef3c5e1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:22.024028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-e804756c-604b-4fc9-a967-c9f08ef3c5e1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:22.031927 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e804756c-604b-4fc9-a967-c9f08ef3c5e1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:22.032478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e804756c-604b-4fc9-a967-c9f08ef3c5e1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:22.033537 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e804756c-604b-4fc9-a967-c9f08ef3c5e1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:22.033986 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e804756c-604b-4fc9-a967-c9f08ef3c5e1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:22.167607 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-e804756c-604b-4fc9-a967-c9f08ef3c5e1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:22.176003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-e804756c-604b-4fc9-a967-c9f08ef3c5e1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1735 microversion: 2.1 time: 0.156819 May 16 20:41:22.176613 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 267/535] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:22 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:23.200163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e5b0e381-9d63-40cd-9dcc-a2af9a62e282 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:23.201089 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-e5b0e381-9d63-40cd-9dcc-a2af9a62e282 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:23.209366 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e5b0e381-9d63-40cd-9dcc-a2af9a62e282 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:23.209860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e5b0e381-9d63-40cd-9dcc-a2af9a62e282 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:23.210711 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e5b0e381-9d63-40cd-9dcc-a2af9a62e282 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:23.211194 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e5b0e381-9d63-40cd-9dcc-a2af9a62e282 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:23.342491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e5b0e381-9d63-40cd-9dcc-a2af9a62e282 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:23.350767 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-e5b0e381-9d63-40cd-9dcc-a2af9a62e282 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1735 microversion: 2.1 time: 0.157453 May 16 20:41:23.351312 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 269/536] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:23 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:24.293656 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-a3af7f0f-e096-4c99-b3d6-a86215e44e2c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:24.294488 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-a3af7f0f-e096-4c99-b3d6-a86215e44e2c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:24.304241 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a3af7f0f-e096-4c99-b3d6-a86215e44e2c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:24.304795 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a3af7f0f-e096-4c99-b3d6-a86215e44e2c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:24.305789 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a3af7f0f-e096-4c99-b3d6-a86215e44e2c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:24.306503 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a3af7f0f-e096-4c99-b3d6-a86215e44e2c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:24.331091 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-a3af7f0f-e096-4c99-b3d6-a86215e44e2c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31/ips" status: 200 len: 150 microversion: 2.1 time: 0.044422 May 16 20:41:24.331662 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 268/537] 10.222.0.49 () {58 vars in 1247 bytes} [Mon May 16 20:41:24 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:41:24.368406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-198eaffc-ef0c-48b4-a427-94831393bab0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:24.369066 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-198eaffc-ef0c-48b4-a427-94831393bab0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:24.376116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-198eaffc-ef0c-48b4-a427-94831393bab0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:24.376595 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-198eaffc-ef0c-48b4-a427-94831393bab0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:24.377380 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-198eaffc-ef0c-48b4-a427-94831393bab0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:24.377849 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-198eaffc-ef0c-48b4-a427-94831393bab0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:24.760216 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-198eaffc-ef0c-48b4-a427-94831393bab0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:24.769306 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-198eaffc-ef0c-48b4-a427-94831393bab0 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1735 microversion: 2.1 time: 0.404929 May 16 20:41:24.769905 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 270/538] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:24 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1735 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:25.700105 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-b72f3b69-49f2-46fd-a388-9b7cea6ae681 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "365380fc-dde8-4d60-9ae8-92492cbb4689"}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:41:25.701220 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-b72f3b69-49f2-46fd-a388-9b7cea6ae681 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:25.707775 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b72f3b69-49f2-46fd-a388-9b7cea6ae681 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:25.708219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b72f3b69-49f2-46fd-a388-9b7cea6ae681 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:25.709010 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b72f3b69-49f2-46fd-a388-9b7cea6ae681 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:25.709440 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b72f3b69-49f2-46fd-a388-9b7cea6ae681 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:25.787276 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-80087637-4f6e-4dae-838f-e3249ddbabdb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:25.787925 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-80087637-4f6e-4dae-838f-e3249ddbabdb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:25.796096 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-80087637-4f6e-4dae-838f-e3249ddbabdb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:25.796577 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-80087637-4f6e-4dae-838f-e3249ddbabdb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:25.797358 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-80087637-4f6e-4dae-838f-e3249ddbabdb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:25.797793 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-80087637-4f6e-4dae-838f-e3249ddbabdb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:25.929970 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-80087637-4f6e-4dae-838f-e3249ddbabdb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:25.937918 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-80087637-4f6e-4dae-838f-e3249ddbabdb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1735 microversion: 2.1 time: 0.155199 May 16 20:41:25.938514 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 271/539] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:25 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:25.954173 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-b72f3b69-49f2-46fd-a388-9b7cea6ae681 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "POST /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257936 May 16 20:41:25.954779 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 269/540] 10.222.0.49 () {60 vars in 1322 bytes} [Mon May 16 20:41:25 2022] POST /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:41:26.955384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-3314b7f2-6dcf-4b91-9cf1-39d22ab4f3bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:26.956000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-3314b7f2-6dcf-4b91-9cf1-39d22ab4f3bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:26.963493 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3314b7f2-6dcf-4b91-9cf1-39d22ab4f3bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:26.963966 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3314b7f2-6dcf-4b91-9cf1-39d22ab4f3bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:26.965090 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3314b7f2-6dcf-4b91-9cf1-39d22ab4f3bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:26.965538 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3314b7f2-6dcf-4b91-9cf1-39d22ab4f3bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:27.099588 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3314b7f2-6dcf-4b91-9cf1-39d22ab4f3bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:27.108130 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-3314b7f2-6dcf-4b91-9cf1-39d22ab4f3bb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1735 microversion: 2.1 time: 0.156684 May 16 20:41:27.108735 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 272/541] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:26 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:28.125601 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-1764351a-e424-4063-895d-63543f75a808 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:28.126296 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-1764351a-e424-4063-895d-63543f75a808 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:28.133202 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1764351a-e424-4063-895d-63543f75a808 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:28.133647 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1764351a-e424-4063-895d-63543f75a808 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:28.134404 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1764351a-e424-4063-895d-63543f75a808 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:28.134830 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1764351a-e424-4063-895d-63543f75a808 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:28.268506 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-1764351a-e424-4063-895d-63543f75a808 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:28.277410 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-1764351a-e424-4063-895d-63543f75a808 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1735 microversion: 2.1 time: 0.156031 May 16 20:41:28.277992 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 270/542] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:28 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:29.295158 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-22724a84-4b1d-4f01-b592-2c7385b224b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:29.295721 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-22724a84-4b1d-4f01-b592-2c7385b224b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:29.302799 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-22724a84-4b1d-4f01-b592-2c7385b224b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:29.303254 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-22724a84-4b1d-4f01-b592-2c7385b224b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:29.304029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-22724a84-4b1d-4f01-b592-2c7385b224b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:29.304468 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-22724a84-4b1d-4f01-b592-2c7385b224b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:29.434542 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-22724a84-4b1d-4f01-b592-2c7385b224b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:29.442530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-22724a84-4b1d-4f01-b592-2c7385b224b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1735 microversion: 2.1 time: 0.151966 May 16 20:41:29.443104 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 273/543] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:29 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:30.459667 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-8f3d9d5c-2f26-46e1-893b-3360758be3ce tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:30.460233 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-8f3d9d5c-2f26-46e1-893b-3360758be3ce tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:30.467557 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8f3d9d5c-2f26-46e1-893b-3360758be3ce tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:30.468160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8f3d9d5c-2f26-46e1-893b-3360758be3ce tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:30.468978 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8f3d9d5c-2f26-46e1-893b-3360758be3ce tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:30.469411 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8f3d9d5c-2f26-46e1-893b-3360758be3ce tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:30.602407 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-8f3d9d5c-2f26-46e1-893b-3360758be3ce tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:30.611032 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-8f3d9d5c-2f26-46e1-893b-3360758be3ce tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1735 microversion: 2.1 time: 0.155505 May 16 20:41:30.611613 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 271/544] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:30 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:31.632561 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-cd9026ff-80ce-401e-a1dd-c9ce473b2008 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:31.633418 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-cd9026ff-80ce-401e-a1dd-c9ce473b2008 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:31.641121 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cd9026ff-80ce-401e-a1dd-c9ce473b2008 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:31.641572 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cd9026ff-80ce-401e-a1dd-c9ce473b2008 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:31.642358 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cd9026ff-80ce-401e-a1dd-c9ce473b2008 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:31.642789 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-cd9026ff-80ce-401e-a1dd-c9ce473b2008 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:31.769339 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-cd9026ff-80ce-401e-a1dd-c9ce473b2008 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:31.779893 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-cd9026ff-80ce-401e-a1dd-c9ce473b2008 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1735 microversion: 2.1 time: 0.153914 May 16 20:41:31.780471 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 274/545] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:31 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:32.797810 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2c923796-12c1-4bcf-acb8-e653d5bd30b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:32.798377 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-2c923796-12c1-4bcf-acb8-e653d5bd30b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:32.805706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2c923796-12c1-4bcf-acb8-e653d5bd30b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:32.806155 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2c923796-12c1-4bcf-acb8-e653d5bd30b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:32.806924 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2c923796-12c1-4bcf-acb8-e653d5bd30b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:32.807399 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2c923796-12c1-4bcf-acb8-e653d5bd30b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:32.947599 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-2c923796-12c1-4bcf-acb8-e653d5bd30b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:32.956473 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-2c923796-12c1-4bcf-acb8-e653d5bd30b9 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1735 microversion: 2.1 time: 0.162560 May 16 20:41:32.957087 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 272/546] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:32 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:33.490756 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-463a2680-0b5d-4285-91a6-391ce8d691c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "365380fc-dde8-4d60-9ae8-92492cbb4689"}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:41:33.491882 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-463a2680-0b5d-4285-91a6-391ce8d691c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:33.498369 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-463a2680-0b5d-4285-91a6-391ce8d691c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:33.498813 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-463a2680-0b5d-4285-91a6-391ce8d691c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:33.499572 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-463a2680-0b5d-4285-91a6-391ce8d691c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:33.499999 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-463a2680-0b5d-4285-91a6-391ce8d691c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:33.588101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-463a2680-0b5d-4285-91a6-391ce8d691c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] HTTP exception thrown: Invalid volume: volume 365380fc-dde8-4d60-9ae8-92492cbb4689 is already attached to instances: c5cee6b8-329b-4d56-b979-3fa246901f31 May 16 20:41:33.590112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-463a2680-0b5d-4285-91a6-391ce8d691c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Request method failure captured: May 16 20:41:33.590112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: POST /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31/os-volume_attachments HTTP/1.1 May 16 20:41:33.590112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:41:33.590112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:41:33.590112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:41:33.590112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 74 May 16 20:41:33.590112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:41:33.590112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:41:33.590112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:41:33.590112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:41:33.590112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrXoPH7QRaaUNABjfpjkYuYjuc4YT0JGIT87HUhaS5B5EXLX9gs5SGdefatz8rk10ofLrDlfVl0DHS_o7l3BlYtbJjSH31X6xpm4OYuntjQCYXgO_XFh2HlouaxMKjcOnmFJvaHNJ-XXm3gC4mA2DpJBa428rLJJY3RCeZ4NRvaKM9I May 16 20:41:33.590112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:41:33.590112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:41:33.590112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:41:33.590112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:41:33.590112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:41:33.590112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:41:33.590112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:41:33.590112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:41:33.590112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:41:33.590112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:41:33.591607 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}] May 16 20:41:33.591607 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:41:33.591607 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:41:33.591607 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:41:33.591607 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:41:33.591607 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:41:33.591607 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:41:33.591607 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: b578680e88c741bda2c8e56b2dc9d335 May 16 20:41:33.591607 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:41:33.591607 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: May 16 20:41:33.591607 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {"volumeAttachment": {"volumeId": "365380fc-dde8-4d60-9ae8-92492cbb4689"}} May 16 20:41:33.591607 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:41:33.592509 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Invalid volume: volume 365380fc-dde8-4d60-9ae8-92492cbb4689 is already attached to instances: c5cee6b8-329b-4d56-b979-3fa246901f31 May 16 20:41:33.592509 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'server_id': 'c5cee6b8-329b-4d56-b979-3fa246901f31', 'body': {'volumeAttachment': {'volumeId': '365380fc-dde8-4d60-9ae8-92492cbb4689'}}} May 16 20:41:33.592509 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:41:33.592509 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:41:33.592509 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 20:41:33.592509 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 20:41:33.592509 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 20:41:33.592509 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 20:41:33.592509 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 16 20:41:33.592509 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 16 20:41:33.592509 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 16 20:41:33.592509 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 16 20:41:33.592509 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 16 20:41:33.592509 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 16 20:41:33.592509 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 365380fc-dde8-4d60-9ae8-92492cbb4689 is already attached to instances: c5cee6b8-329b-4d56-b979-3fa246901f31 May 16 20:41:33.592509 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:41:33.592509 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:41:33.592509 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:41:33.592509 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:41:33.593790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:41:33.593790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:41:33.593790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:41:33.593790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:41:33.593790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:41:33.593790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:41:33.593790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 20:41:33.593790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 20:41:33.593790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 20:41:33.593790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 20:41:33.593790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 20:41:33.593790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 20:41:33.593790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 16 20:41:33.593790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 16 20:41:33.593790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 365380fc-dde8-4d60-9ae8-92492cbb4689 is already attached to instances: c5cee6b8-329b-4d56-b979-3fa246901f31 May 16 20:41:33.593790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:41:33.593790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:41:33.593790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:41:33.593790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:41:33.593790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:41:33.595030 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:41:33.595030 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:41:33.595030 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:41:33.595030 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 365380fc-dde8-4d60-9ae8-92492cbb4689 is already attached to instances: c5cee6b8-329b-4d56-b979-3fa246901f31 May 16 20:41:33.595030 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:41:33.595030 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-463a2680-0b5d-4285-91a6-391ce8d691c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Returning 400 to user: Invalid volume: volume 365380fc-dde8-4d60-9ae8-92492cbb4689 is already attached to instances: c5cee6b8-329b-4d56-b979-3fa246901f31 {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:41:33.595030 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-463a2680-0b5d-4285-91a6-391ce8d691c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "POST /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104823 May 16 20:41:33.595030 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 275/547] 10.222.0.49 () {60 vars in 1322 bytes} [Mon May 16 20:41:33 2022] POST /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 20:41:33.653304 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-5f12c0c6-fe7f-423b-8809-26f3f6c126cf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:33.653794 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-5f12c0c6-fe7f-423b-8809-26f3f6c126cf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:33.661230 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5f12c0c6-fe7f-423b-8809-26f3f6c126cf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:33.661773 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5f12c0c6-fe7f-423b-8809-26f3f6c126cf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:33.663019 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5f12c0c6-fe7f-423b-8809-26f3f6c126cf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:33.663616 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5f12c0c6-fe7f-423b-8809-26f3f6c126cf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:33.798828 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.objects.instance [None req-5f12c0c6-fe7f-423b-8809-26f3f6c126cf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lazy-loading 'services' on Instance uuid c5cee6b8-329b-4d56-b979-3fa246901f31 {{(pid=123563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:41:33.916702 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-5f12c0c6-fe7f-423b-8809-26f3f6c126cf tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31/os-volume_attachments/365380fc-dde8-4d60-9ae8-92492cbb4689" status: 202 len: 0 microversion: 2.1 time: 0.268508 May 16 20:41:33.917292 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 273/548] 10.222.0.49 () {58 vars in 1415 bytes} [Mon May 16 20:41:33 2022] DELETE /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31/os-volume_attachments/365380fc-dde8-4d60-9ae8-92492cbb4689 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:41:33.925672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-7fc40b47-f789-4c42-bedd-02631d3dca05 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:33.926611 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-7fc40b47-f789-4c42-bedd-02631d3dca05 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:33.933584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7fc40b47-f789-4c42-bedd-02631d3dca05 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:33.934026 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7fc40b47-f789-4c42-bedd-02631d3dca05 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:33.934790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7fc40b47-f789-4c42-bedd-02631d3dca05 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:33.935238 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-7fc40b47-f789-4c42-bedd-02631d3dca05 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:33.965800 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-7fc40b47-f789-4c42-bedd-02631d3dca05 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043943 May 16 20:41:33.966396 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 276/549] 10.222.0.49 () {58 vars in 1301 bytes} [Mon May 16 20:41:33 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:41:33.974837 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-3c111a7c-af38-4299-859b-10dbb264ddfb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:33.975549 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-3c111a7c-af38-4299-859b-10dbb264ddfb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:33.982106 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3c111a7c-af38-4299-859b-10dbb264ddfb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:33.982565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3c111a7c-af38-4299-859b-10dbb264ddfb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:33.983339 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3c111a7c-af38-4299-859b-10dbb264ddfb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:33.983778 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3c111a7c-af38-4299-859b-10dbb264ddfb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:34.116498 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-3c111a7c-af38-4299-859b-10dbb264ddfb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:34.125158 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-3c111a7c-af38-4299-859b-10dbb264ddfb tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1735 microversion: 2.1 time: 0.154843 May 16 20:41:34.125764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 274/550] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:33 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:41:34.977447 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-d7f7b623-4f64-4adf-a69d-16e65293248c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:34.978364 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-d7f7b623-4f64-4adf-a69d-16e65293248c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:34.985234 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d7f7b623-4f64-4adf-a69d-16e65293248c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:34.985680 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d7f7b623-4f64-4adf-a69d-16e65293248c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:34.986440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d7f7b623-4f64-4adf-a69d-16e65293248c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:34.986865 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d7f7b623-4f64-4adf-a69d-16e65293248c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:35.016707 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-d7f7b623-4f64-4adf-a69d-16e65293248c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043182 May 16 20:41:35.017246 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 277/551] 10.222.0.49 () {58 vars in 1301 bytes} [Mon May 16 20:41:34 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:41:35.143460 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-f8ca7b79-544f-4d89-a00b-871ccedf91f4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:35.144025 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-f8ca7b79-544f-4d89-a00b-871ccedf91f4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:35.150833 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f8ca7b79-544f-4d89-a00b-871ccedf91f4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:35.151282 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f8ca7b79-544f-4d89-a00b-871ccedf91f4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:35.152046 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f8ca7b79-544f-4d89-a00b-871ccedf91f4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:35.152530 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f8ca7b79-544f-4d89-a00b-871ccedf91f4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:35.286774 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f8ca7b79-544f-4d89-a00b-871ccedf91f4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:35.295303 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-f8ca7b79-544f-4d89-a00b-871ccedf91f4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1735 microversion: 2.1 time: 0.155851 May 16 20:41:35.295899 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 275/552] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:35 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:36.032484 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-814c1299-4517-4b87-8e4f-b167a602b251 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:36.033909 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-814c1299-4517-4b87-8e4f-b167a602b251 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:36.043652 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-814c1299-4517-4b87-8e4f-b167a602b251 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:36.044111 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-814c1299-4517-4b87-8e4f-b167a602b251 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:36.044903 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-814c1299-4517-4b87-8e4f-b167a602b251 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:36.045336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-814c1299-4517-4b87-8e4f-b167a602b251 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:36.076474 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-814c1299-4517-4b87-8e4f-b167a602b251 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050697 May 16 20:41:36.077052 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 278/553] 10.222.0.49 () {58 vars in 1301 bytes} [Mon May 16 20:41:36 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 20:41:36.136474 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-b2499cc1-f844-4501-91b7-09045c92ab71 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:36.137836 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-b2499cc1-f844-4501-91b7-09045c92ab71 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:36.145130 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b2499cc1-f844-4501-91b7-09045c92ab71 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:36.146280 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b2499cc1-f844-4501-91b7-09045c92ab71 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:36.146562 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b2499cc1-f844-4501-91b7-09045c92ab71 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:36.147194 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b2499cc1-f844-4501-91b7-09045c92ab71 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:36.178570 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-b2499cc1-f844-4501-91b7-09045c92ab71 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Going to try to terminate instance {{(pid=123563) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:41:36.261268 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-b2499cc1-f844-4501-91b7-09045c92ab71 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31" status: 204 len: 0 microversion: 2.1 time: 0.128418 May 16 20:41:36.262126 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 276/554] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:41:36 2022] DELETE /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 20:41:36.270291 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-46a4d97e-820c-4afe-b708-843096888e38 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:36.271058 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-46a4d97e-820c-4afe-b708-843096888e38 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:36.277984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-46a4d97e-820c-4afe-b708-843096888e38 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:36.278467 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-46a4d97e-820c-4afe-b708-843096888e38 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:36.279209 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-46a4d97e-820c-4afe-b708-843096888e38 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:36.279639 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-46a4d97e-820c-4afe-b708-843096888e38 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:36.316320 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7bb4a091-bd50-4cdd-a8b6-c754d5017f7b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:36.317310 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-7bb4a091-bd50-4cdd-a8b6-c754d5017f7b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:36.325614 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7bb4a091-bd50-4cdd-a8b6-c754d5017f7b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:36.326067 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7bb4a091-bd50-4cdd-a8b6-c754d5017f7b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:36.326884 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7bb4a091-bd50-4cdd-a8b6-c754d5017f7b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:36.327393 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7bb4a091-bd50-4cdd-a8b6-c754d5017f7b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:36.461927 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-46a4d97e-820c-4afe-b708-843096888e38 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:36.469756 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-46a4d97e-820c-4afe-b708-843096888e38 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31" status: 200 len: 1683 microversion: 2.1 time: 0.203313 May 16 20:41:36.470357 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 279/555] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:36 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 => generated 1683 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:41:36.491318 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-7bb4a091-bd50-4cdd-a8b6-c754d5017f7b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:36.499710 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-7bb4a091-bd50-4cdd-a8b6-c754d5017f7b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1715 microversion: 2.1 time: 0.190216 May 16 20:41:36.500283 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 277/556] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:36 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1715 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:36.555997 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-204609c5-dae6-44bd-b16e-7e5cefe4be76 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:36.556518 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-204609c5-dae6-44bd-b16e-7e5cefe4be76 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:36.563150 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-204609c5-dae6-44bd-b16e-7e5cefe4be76 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:36.563601 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-204609c5-dae6-44bd-b16e-7e5cefe4be76 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:36.564363 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-204609c5-dae6-44bd-b16e-7e5cefe4be76 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:36.564844 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-204609c5-dae6-44bd-b16e-7e5cefe4be76 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:36.648653 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-204609c5-dae6-44bd-b16e-7e5cefe4be76 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] HTTP exception thrown: Cannot 'detach_volume' instance dc01c3eb-3650-4295-b423-03ff2d49e945 while it is in vm_state rescued May 16 20:41:36.650163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-204609c5-dae6-44bd-b16e-7e5cefe4be76 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Request method failure captured: May 16 20:41:36.650163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: DELETE /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945/os-volume_attachments/0ca9d73c-53ef-484c-a1c8-1448a967bb83 HTTP/1.1 May 16 20:41:36.650163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:41:36.650163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:41:36.650163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:41:36.650163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:41:36.650163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:41:36.650163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:41:36.650163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:41:36.650163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:41:36.650163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrYz-yjVKwgSFfN0eLNagUyRjDkS79jG85WNDPi_wT024qE-ANQLmJ-KHEJ6Vnv8ngmMt0zEUKEE8CtESkh62DxmHenCL5YAhZjLMoCaFCWuXPk0rDXBZ7EBJ6W3SjHCtjbuNDPg0vhkDGdSnh6SHKwG6VwkTaeY6mnwE6Exhy0aLX0 May 16 20:41:36.650163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:41:36.650163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:41:36.650163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:41:36.650163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:41:36.650163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:41:36.650163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:41:36.650163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 69e39fae43c341798f00e3b48f20d003 May 16 20:41:36.650163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1585639724 May 16 20:41:36.650163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:41:36.650163 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:41:36.651521 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_69e39fae43c341798f00e3b48f20d003"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e39fae43c341798f00e3b48f20d003"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/69e39fae43c341798f00e3b48f20d003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e39fae43c341798f00e3b48f20d003"}]}] May 16 20:41:36.651521 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1585639724 May 16 20:41:36.651521 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 69e39fae43c341798f00e3b48f20d003 May 16 20:41:36.651521 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1585639724 May 16 20:41:36.651521 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-ServerRescueNegativeTestJSON-1585639724-project May 16 20:41:36.651521 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:41:36.651521 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:41:36.651521 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: 20c57f1318cd4c73b2248b2d02896176 May 16 20:41:36.651521 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1585639724-project May 16 20:41:36.651521 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:41:36.651521 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Cannot 'detach_volume' instance dc01c3eb-3650-4295-b423-03ff2d49e945 while it is in vm_state rescued May 16 20:41:36.652181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'server_id': 'dc01c3eb-3650-4295-b423-03ff2d49e945', 'id': '0ca9d73c-53ef-484c-a1c8-1448a967bb83'} May 16 20:41:36.652181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:41:36.652181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:41:36.652181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 16 20:41:36.652181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 16 20:41:36.652181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 20:41:36.652181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 20:41:36.652181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 16 20:41:36.652181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 16 20:41:36.652181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dc01c3eb-3650-4295-b423-03ff2d49e945 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 16 20:41:36.652181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:41:36.652181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:41:36.652181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:41:36.652181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:41:36.652181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:41:36.652181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:41:36.652181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:41:36.652181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:41:36.652181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:41:36.652181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:41:36.653464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 16 20:41:36.653464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 16 20:41:36.653464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 16 20:41:36.653464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 16 20:41:36.653464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance dc01c3eb-3650-4295-b423-03ff2d49e945 while it is in vm_state rescued May 16 20:41:36.653464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:41:36.653464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:41:36.653464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:41:36.653464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:41:36.653464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:41:36.653464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:41:36.653464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:41:36.653464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:41:36.653464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance dc01c3eb-3650-4295-b423-03ff2d49e945 while it is in vm_state rescued May 16 20:41:36.653464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:41:36.653464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-204609c5-dae6-44bd-b16e-7e5cefe4be76 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Returning 409 to user: Cannot 'detach_volume' instance dc01c3eb-3650-4295-b423-03ff2d49e945 while it is in vm_state rescued {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:41:36.654909 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-204609c5-dae6-44bd-b16e-7e5cefe4be76 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945/os-volume_attachments/0ca9d73c-53ef-484c-a1c8-1448a967bb83" status: 409 len: 152 microversion: 2.1 time: 0.100054 May 16 20:41:36.654909 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 280/557] 10.222.0.49 () {58 vars in 1415 bytes} [Mon May 16 20:41:36 2022] DELETE /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945/os-volume_attachments/0ca9d73c-53ef-484c-a1c8-1448a967bb83 => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 16 20:41:36.660919 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-ac1fbce7-a1b6-493a-84cb-89f437857646 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:41:36.661468 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-ac1fbce7-a1b6-493a-84cb-89f437857646 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:36.667681 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ac1fbce7-a1b6-493a-84cb-89f437857646 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:36.668163 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ac1fbce7-a1b6-493a-84cb-89f437857646 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:36.668966 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ac1fbce7-a1b6-493a-84cb-89f437857646 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:36.669410 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ac1fbce7-a1b6-493a-84cb-89f437857646 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:36.737791 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-ac1fbce7-a1b6-493a-84cb-89f437857646 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "POST /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945/action" status: 202 len: 0 microversion: 2.1 time: 0.080675 May 16 20:41:36.738393 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 278/558] 10.222.0.49 () {60 vars in 1277 bytes} [Mon May 16 20:41:36 2022] POST /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:41:36.749104 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-95d720d3-c3b3-45d4-96d3-755401fdb344 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:36.750023 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-95d720d3-c3b3-45d4-96d3-755401fdb344 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:36.757776 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-95d720d3-c3b3-45d4-96d3-755401fdb344 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:36.758242 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-95d720d3-c3b3-45d4-96d3-755401fdb344 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:36.759017 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-95d720d3-c3b3-45d4-96d3-755401fdb344 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:36.759444 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-95d720d3-c3b3-45d4-96d3-755401fdb344 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:36.899933 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-95d720d3-c3b3-45d4-96d3-755401fdb344 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:36.912484 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-95d720d3-c3b3-45d4-96d3-755401fdb344 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1723 microversion: 2.1 time: 0.169121 May 16 20:41:36.913299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 281/559] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:36 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:37.493143 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-a2a79439-baf9-4cd2-ab7e-a09aa9da317d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:37.494283 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-a2a79439-baf9-4cd2-ab7e-a09aa9da317d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:37.505091 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a2a79439-baf9-4cd2-ab7e-a09aa9da317d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:37.505850 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a2a79439-baf9-4cd2-ab7e-a09aa9da317d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:37.507145 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a2a79439-baf9-4cd2-ab7e-a09aa9da317d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:37.507845 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a2a79439-baf9-4cd2-ab7e-a09aa9da317d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:37.661804 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a2a79439-baf9-4cd2-ab7e-a09aa9da317d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:37.669285 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-a2a79439-baf9-4cd2-ab7e-a09aa9da317d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31" status: 200 len: 1683 microversion: 2.1 time: 0.184065 May 16 20:41:37.669861 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 279/560] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:37 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 => generated 1683 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:37.931608 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-97433fde-ed07-4cc3-b8f6-4b224f40a78c tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:37.932609 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-97433fde-ed07-4cc3-b8f6-4b224f40a78c tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:37.939354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-97433fde-ed07-4cc3-b8f6-4b224f40a78c tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:37.939812 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-97433fde-ed07-4cc3-b8f6-4b224f40a78c tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:37.940627 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-97433fde-ed07-4cc3-b8f6-4b224f40a78c tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:37.941067 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-97433fde-ed07-4cc3-b8f6-4b224f40a78c tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:38.163080 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-97433fde-ed07-4cc3-b8f6-4b224f40a78c tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:38.171945 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-97433fde-ed07-4cc3-b8f6-4b224f40a78c tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1723 microversion: 2.1 time: 0.244684 May 16 20:41:38.181715 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 282/561] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:37 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:38.687680 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-686bf198-f690-4062-930d-226a62e83088 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:38.688299 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-686bf198-f690-4062-930d-226a62e83088 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:38.695015 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-686bf198-f690-4062-930d-226a62e83088 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:38.695477 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-686bf198-f690-4062-930d-226a62e83088 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:38.696255 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-686bf198-f690-4062-930d-226a62e83088 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:38.696726 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-686bf198-f690-4062-930d-226a62e83088 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:38.778428 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-686bf198-f690-4062-930d-226a62e83088 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:38.786282 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-686bf198-f690-4062-930d-226a62e83088 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31" status: 200 len: 1615 microversion: 2.1 time: 0.102698 May 16 20:41:38.786898 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 280/562] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:38 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 => generated 1615 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:38.892948 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-dab397db-29ee-44dc-82cb-2bb09ccd331c req-58cfacb5-f88c-49f8-af32-ab245cccd72a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5cee6b8-329b-4d56-b979-3fa246901f31", "name": "network-vif-deleted", "tag": "0dfb95f5-6a21-4b0f-9c2a-3d4cea6d3b5e"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:41:38.901271 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-dab397db-29ee-44dc-82cb-2bb09ccd331c req-58cfacb5-f88c-49f8-af32-ab245cccd72a service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:38.901717 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-dab397db-29ee-44dc-82cb-2bb09ccd331c req-58cfacb5-f88c-49f8-af32-ab245cccd72a service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:38.913117 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-dab397db-29ee-44dc-82cb-2bb09ccd331c req-58cfacb5-f88c-49f8-af32-ab245cccd72a service nova] Creating event network-vif-deleted:0dfb95f5-6a21-4b0f-9c2a-3d4cea6d3b5e for instance c5cee6b8-329b-4d56-b979-3fa246901f31 on hv-cinder-77703 May 16 20:41:38.920002 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-dab397db-29ee-44dc-82cb-2bb09ccd331c req-58cfacb5-f88c-49f8-af32-ab245cccd72a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030697 May 16 20:41:38.920620 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 283/563] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:41:39.188811 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-36212dbf-06c1-4bcf-8c07-a5d8bd4f32c2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:39.189427 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-36212dbf-06c1-4bcf-8c07-a5d8bd4f32c2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:39.195477 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-36212dbf-06c1-4bcf-8c07-a5d8bd4f32c2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:39.195966 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-36212dbf-06c1-4bcf-8c07-a5d8bd4f32c2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:39.196766 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-36212dbf-06c1-4bcf-8c07-a5d8bd4f32c2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:39.197208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-36212dbf-06c1-4bcf-8c07-a5d8bd4f32c2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:39.330424 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-36212dbf-06c1-4bcf-8c07-a5d8bd4f32c2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:39.338198 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-36212dbf-06c1-4bcf-8c07-a5d8bd4f32c2 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1723 microversion: 2.1 time: 0.153373 May 16 20:41:39.338923 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 281/564] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:39 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:39.804611 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-13a55cbf-aa5c-4ef2-862b-31f73f66d15a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:39.805360 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-13a55cbf-aa5c-4ef2-862b-31f73f66d15a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:39.812302 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-13a55cbf-aa5c-4ef2-862b-31f73f66d15a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:39.812991 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-13a55cbf-aa5c-4ef2-862b-31f73f66d15a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:39.813756 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-13a55cbf-aa5c-4ef2-862b-31f73f66d15a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:39.814198 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-13a55cbf-aa5c-4ef2-862b-31f73f66d15a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:39.847516 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-13a55cbf-aa5c-4ef2-862b-31f73f66d15a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:39.847955 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-13a55cbf-aa5c-4ef2-862b-31f73f66d15a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:39.848393 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.objects.instance [None req-13a55cbf-aa5c-4ef2-862b-31f73f66d15a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lazy-loading 'fault' on Instance uuid c5cee6b8-329b-4d56-b979-3fa246901f31 {{(pid=123564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:41:39.894456 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-13a55cbf-aa5c-4ef2-862b-31f73f66d15a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:39.902384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-13a55cbf-aa5c-4ef2-862b-31f73f66d15a tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31" status: 200 len: 1332 microversion: 2.1 time: 0.102473 May 16 20:41:39.903096 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 284/565] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:39 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:40.358508 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-27207c11-1b40-4328-87f8-f8105d7fc872 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:40.359219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-27207c11-1b40-4328-87f8-f8105d7fc872 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:40.367051 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-27207c11-1b40-4328-87f8-f8105d7fc872 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:40.367573 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-27207c11-1b40-4328-87f8-f8105d7fc872 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:40.368511 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-27207c11-1b40-4328-87f8-f8105d7fc872 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:40.368999 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-27207c11-1b40-4328-87f8-f8105d7fc872 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:40.508157 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-27207c11-1b40-4328-87f8-f8105d7fc872 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:40.518365 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-27207c11-1b40-4328-87f8-f8105d7fc872 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1729 microversion: 2.1 time: 0.165477 May 16 20:41:40.518937 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 282/566] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:40 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:40.534932 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-20066621-35a3-4395-b964-3e0dbdbd0c85 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:40.535446 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-20066621-35a3-4395-b964-3e0dbdbd0c85 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:40.541897 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-20066621-35a3-4395-b964-3e0dbdbd0c85 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:40.542355 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-20066621-35a3-4395-b964-3e0dbdbd0c85 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:40.543226 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-20066621-35a3-4395-b964-3e0dbdbd0c85 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:40.543664 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-20066621-35a3-4395-b964-3e0dbdbd0c85 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:40.618499 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-20066621-35a3-4395-b964-3e0dbdbd0c85 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087398 May 16 20:41:40.619072 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 285/567] 10.222.0.49 () {58 vars in 1274 bytes} [Mon May 16 20:41:40 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:41:40.919307 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-82d89a91-9136-4380-b984-c2e226fee603 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:40.919922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-82d89a91-9136-4380-b984-c2e226fee603 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:40.926349 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-82d89a91-9136-4380-b984-c2e226fee603 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:40.926792 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-82d89a91-9136-4380-b984-c2e226fee603 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:40.927565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-82d89a91-9136-4380-b984-c2e226fee603 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:40.928369 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-82d89a91-9136-4380-b984-c2e226fee603 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:40.942104 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-82d89a91-9136-4380-b984-c2e226fee603 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] HTTP exception thrown: Instance c5cee6b8-329b-4d56-b979-3fa246901f31 could not be found. May 16 20:41:40.943752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-82d89a91-9136-4380-b984-c2e226fee603 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Request method failure captured: May 16 20:41:40.943752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 HTTP/1.1 May 16 20:41:40.943752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:41:40.943752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:41:40.943752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:41:40.943752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:41:40.943752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:41:40.943752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:41:40.943752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:41:40.943752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:41:40.943752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrXoPH7QRaaUNABjfpjkYuYjuc4YT0JGIT87HUhaS5B5EXLX9gs5SGdefatz8rk10ofLrDlfVl0DHS_o7l3BlYtbJjSH31X6xpm4OYuntjQCYXgO_XFh2HlouaxMKjcOnmFJvaHNJ-XXm3gC4mA2DpJBa428rLJJY3RCeZ4NRvaKM9I May 16 20:41:40.943752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:41:40.943752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:41:40.943752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:41:40.943752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:41:40.943752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:41:40.943752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:41:40.943752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:41:40.943752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:41:40.943752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:41:40.943752 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:41:40.945238 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}] May 16 20:41:40.945238 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:41:40.945238 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:41:40.945238 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:41:40.945238 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:41:40.945238 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:41:40.945238 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:41:40.945238 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: b578680e88c741bda2c8e56b2dc9d335 May 16 20:41:40.945238 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:41:40.945238 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: > May 16 20:41:40.945238 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Instance c5cee6b8-329b-4d56-b979-3fa246901f31 could not be found. May 16 20:41:40.945238 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': 'c5cee6b8-329b-4d56-b979-3fa246901f31'} May 16 20:41:40.946003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:41:40.946003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:41:40.946003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:41:40.946003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:41:40.946003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:41:40.946003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:41:40.946003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:41:40.946003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:41:40.946003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:41:40.946003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:41:40.946003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5cee6b8-329b-4d56-b979-3fa246901f31 could not be found. May 16 20:41:40.946003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:41:40.946003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:41:40.946003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:41:40.946003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:41:40.946003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:41:40.946003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:41:40.946003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:41:40.946003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:41:40.946003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:41:40.947261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:41:40.947261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:41:40.947261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:41:40.947261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:41:40.947261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:41:40.947261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:41:40.947261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:41:40.947261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5cee6b8-329b-4d56-b979-3fa246901f31 could not be found. May 16 20:41:40.947261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:41:40.947261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:41:40.947261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:41:40.947261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:41:40.947261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:41:40.947261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:41:40.947261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:41:40.947261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:41:40.947261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5cee6b8-329b-4d56-b979-3fa246901f31 could not be found. May 16 20:41:40.947261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:41:40.948347 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-82d89a91-9136-4380-b984-c2e226fee603 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Returning 404 to user: Instance c5cee6b8-329b-4d56-b979-3fa246901f31 could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:41:40.948347 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-82d89a91-9136-4380-b984-c2e226fee603 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31" status: 404 len: 111 microversion: 2.1 time: 0.029861 May 16 20:41:40.948347 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 283/568] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:40 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:41:40.954688 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-51227432-4db3-4955-a63a-02d96b4ccfa1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '.version_select at 0x7f81b1129430>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:40.973880 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-51227432-4db3-4955-a63a-02d96b4ccfa1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1485295577" status: 202 len: 0 microversion: 2.1 time: 0.023382 May 16 20:41:40.974460 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 286/569] 10.222.0.49 () {58 vars in 1220 bytes} [Mon May 16 20:41:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1485295577 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 20:41:41.517112 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-ce058d65-92b1-449e-b502-0fb1d5a5afd4 req-69e2a3b6-06eb-49e9-ae64-cf0252fddd1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc01c3eb-3650-4295-b423-03ff2d49e945", "tag": "c9ce98a3-3d13-4c84-9fe3-9b633c649795"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:41:41.528311 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-ce058d65-92b1-449e-b502-0fb1d5a5afd4 req-69e2a3b6-06eb-49e9-ae64-cf0252fddd1b service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:41.529052 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-ce058d65-92b1-449e-b502-0fb1d5a5afd4 req-69e2a3b6-06eb-49e9-ae64-cf0252fddd1b service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:41.541805 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-ce058d65-92b1-449e-b502-0fb1d5a5afd4 req-69e2a3b6-06eb-49e9-ae64-cf0252fddd1b service nova] Creating event network-changed:c9ce98a3-3d13-4c84-9fe3-9b633c649795 for instance dc01c3eb-3650-4295-b423-03ff2d49e945 on hv-cinder-77703 May 16 20:41:41.546942 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-ce058d65-92b1-449e-b502-0fb1d5a5afd4 req-69e2a3b6-06eb-49e9-ae64-cf0252fddd1b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033499 May 16 20:41:41.547647 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 284/570] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:41:41.592659 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-bbad251b-b229-4d94-9150-7d0b99ea6243 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Action: 'create', calling method: .version_select at 0x7f81b10850d0>, body: {"keypair": {"name": "tempest-keypair-1204171031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbvekBRi3YWV0aSllwULvFS1ld+IyLwu8CHMOoR+jLKnXhgYUx8pCet1i5Leb4LZ2st5POYUbLiJZysAriQXMpGBhIztFAzwlhHDsSAwH6Kzyfa58Weipsk3Xb59yRIIw=="}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:41:41.607203 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-bbad251b-b229-4d94-9150-7d0b99ea6243 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Getting quotas for project 2beaab3a72a345d98a9ec4e0ae4686b6. Resources: {'key_pairs'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:41:41.611547 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-bbad251b-b229-4d94-9150-7d0b99ea6243 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Getting quotas for user b578680e88c741bda2c8e56b2dc9d335 and project 2beaab3a72a345d98a9ec4e0ae4686b6. Resources: {'key_pairs'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:41:41.634033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-bbad251b-b229-4d94-9150-7d0b99ea6243 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045173 May 16 20:41:41.634917 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 287/571] 10.222.0.49 () {60 vars in 1158 bytes} [Mon May 16 20:41:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:41:42.897130 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-ac67e62c-8d77-42db-9a96-238bbb25c701 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-40619290", "imageRef": "f9826e12-1d0c-4a5a-9616-338520403016", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51755a9b-e432-418d-95c4-023d6854f406"}], "security_groups": [{"name": "tempest-securitygroup--120468218"}], "key_name": "tempest-keypair-1204171031", "user_data": "}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:41:43.010025 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.network.neutron [None req-ac67e62c-8d77-42db-9a96-238bbb25c701 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] validate_networks() for [('51755a9b-e432-418d-95c4-023d6854f406', None, None, None, None, None)] {{(pid=123563) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:41:43.382741 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-ac67e62c-8d77-42db-9a96-238bbb25c701 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Flavor limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:41:43.383158 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-ac67e62c-8d77-42db-9a96-238bbb25c701 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Image limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:41:43.383619 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-ac67e62c-8d77-42db-9a96-238bbb25c701 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Flavor pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:41:43.384018 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-ac67e62c-8d77-42db-9a96-238bbb25c701 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Image pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:41:43.384418 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-ac67e62c-8d77-42db-9a96-238bbb25c701 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:41:43.393941 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ac67e62c-8d77-42db-9a96-238bbb25c701 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:43.394380 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ac67e62c-8d77-42db-9a96-238bbb25c701 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:43.395169 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ac67e62c-8d77-42db-9a96-238bbb25c701 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:43.395594 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ac67e62c-8d77-42db-9a96-238bbb25c701 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:43.412860 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-ac67e62c-8d77-42db-9a96-238bbb25c701 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Getting quotas for project 2beaab3a72a345d98a9ec4e0ae4686b6. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:41:43.417299 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-ac67e62c-8d77-42db-9a96-238bbb25c701 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Getting quotas for user b578680e88c741bda2c8e56b2dc9d335 and project 2beaab3a72a345d98a9ec4e0ae4686b6. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:41:43.429819 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-ac67e62c-8d77-42db-9a96-238bbb25c701 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Going to run 1 instances... {{(pid=123563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:41:43.432212 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-ac67e62c-8d77-42db-9a96-238bbb25c701 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9826e12-1d0c-4a5a-9616-338520403016',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:41:43.478685 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-ac67e62c-8d77-42db-9a96-238bbb25c701 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.586693 May 16 20:41:43.479456 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 285/572] 10.222.0.49 () {60 vars in 1146 bytes} [Mon May 16 20:41:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 20:41:43.490115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-47e7fb2d-c794-4403-9a24-95c8899b4333 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:43.490731 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-47e7fb2d-c794-4403-9a24-95c8899b4333 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:43.542947 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-47e7fb2d-c794-4403-9a24-95c8899b4333 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:43.549867 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-47e7fb2d-c794-4403-9a24-95c8899b4333 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 200 len: 1240 microversion: 2.1 time: 0.064251 May 16 20:41:43.550433 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 288/573] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:43 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 1240 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:43.563227 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-f80b5ceb-3c6b-41ec-88a7-807f8641535b req-5e5e22dd-08d2-4d18-b1c4-a6519f457b9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc01c3eb-3650-4295-b423-03ff2d49e945", "tag": "c9ce98a3-3d13-4c84-9fe3-9b633c649795"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:41:43.573738 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-f80b5ceb-3c6b-41ec-88a7-807f8641535b req-5e5e22dd-08d2-4d18-b1c4-a6519f457b9f service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:43.574345 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-f80b5ceb-3c6b-41ec-88a7-807f8641535b req-5e5e22dd-08d2-4d18-b1c4-a6519f457b9f service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:43.584910 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-f80b5ceb-3c6b-41ec-88a7-807f8641535b req-5e5e22dd-08d2-4d18-b1c4-a6519f457b9f service nova] Creating event network-changed:c9ce98a3-3d13-4c84-9fe3-9b633c649795 for instance dc01c3eb-3650-4295-b423-03ff2d49e945 on hv-cinder-77703 May 16 20:41:43.589997 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-f80b5ceb-3c6b-41ec-88a7-807f8641535b req-5e5e22dd-08d2-4d18-b1c4-a6519f457b9f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030393 May 16 20:41:43.591139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 286/574] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:41:44.567751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-9f6d3462-91bf-4e5d-84fa-519393053ff1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:44.568366 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-9f6d3462-91bf-4e5d-84fa-519393053ff1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:44.575319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9f6d3462-91bf-4e5d-84fa-519393053ff1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:44.575953 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9f6d3462-91bf-4e5d-84fa-519393053ff1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:44.577160 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9f6d3462-91bf-4e5d-84fa-519393053ff1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:44.577845 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9f6d3462-91bf-4e5d-84fa-519393053ff1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:44.643228 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-9f6d3462-91bf-4e5d-84fa-519393053ff1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:44.650894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-9f6d3462-91bf-4e5d-84fa-519393053ff1 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 200 len: 1298 microversion: 2.1 time: 0.087641 May 16 20:41:44.651490 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 289/575] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:44 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:45.679228 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-8f14cbbd-e083-4d32-8d40-3ee8e69a3cd6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:45.680519 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-8f14cbbd-e083-4d32-8d40-3ee8e69a3cd6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:45.689828 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8f14cbbd-e083-4d32-8d40-3ee8e69a3cd6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:45.690543 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8f14cbbd-e083-4d32-8d40-3ee8e69a3cd6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:45.691773 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8f14cbbd-e083-4d32-8d40-3ee8e69a3cd6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:45.692216 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8f14cbbd-e083-4d32-8d40-3ee8e69a3cd6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:45.830093 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-8f14cbbd-e083-4d32-8d40-3ee8e69a3cd6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:45.837540 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-8f14cbbd-e083-4d32-8d40-3ee8e69a3cd6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 200 len: 1365 microversion: 2.1 time: 0.170877 May 16 20:41:45.838097 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 287/576] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:45 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:45.861730 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-d8d7388f-c06f-483d-a94c-be6948574eb7 req-28de4fbc-e1f8-4ca7-8781-f5100c64ecf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faf5e096-bd76-45d5-a4cc-8a6c1cc08833", "tag": "7cecb240-68ee-4c56-b8b3-d62a8675bc86"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:41:45.871917 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-d8d7388f-c06f-483d-a94c-be6948574eb7 req-28de4fbc-e1f8-4ca7-8781-f5100c64ecf6 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:45.872363 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-d8d7388f-c06f-483d-a94c-be6948574eb7 req-28de4fbc-e1f8-4ca7-8781-f5100c64ecf6 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:45.887010 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-d8d7388f-c06f-483d-a94c-be6948574eb7 req-28de4fbc-e1f8-4ca7-8781-f5100c64ecf6 service nova] Creating event network-changed:7cecb240-68ee-4c56-b8b3-d62a8675bc86 for instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 on hv-cinder-77703 May 16 20:41:45.894623 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-d8d7388f-c06f-483d-a94c-be6948574eb7 req-28de4fbc-e1f8-4ca7-8781-f5100c64ecf6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036503 May 16 20:41:45.896015 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 290/577] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:41:46.858674 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-af8096b6-1143-40dd-8fe9-52629ff91f24 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:46.859617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-af8096b6-1143-40dd-8fe9-52629ff91f24 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:46.870533 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-af8096b6-1143-40dd-8fe9-52629ff91f24 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:46.871407 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-af8096b6-1143-40dd-8fe9-52629ff91f24 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:46.872199 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-af8096b6-1143-40dd-8fe9-52629ff91f24 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:46.872670 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-af8096b6-1143-40dd-8fe9-52629ff91f24 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:47.003365 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-af8096b6-1143-40dd-8fe9-52629ff91f24 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:47.011556 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-af8096b6-1143-40dd-8fe9-52629ff91f24 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 200 len: 1365 microversion: 2.1 time: 0.159567 May 16 20:41:47.012120 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 288/578] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:46 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:48.029473 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-272100b6-c1fc-4c5b-95fb-e14ddaa311a2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:48.030187 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-272100b6-c1fc-4c5b-95fb-e14ddaa311a2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:48.036788 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-272100b6-c1fc-4c5b-95fb-e14ddaa311a2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:48.037242 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-272100b6-c1fc-4c5b-95fb-e14ddaa311a2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:48.038027 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-272100b6-c1fc-4c5b-95fb-e14ddaa311a2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:48.038461 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-272100b6-c1fc-4c5b-95fb-e14ddaa311a2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:48.179578 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-272100b6-c1fc-4c5b-95fb-e14ddaa311a2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:48.187658 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-272100b6-c1fc-4c5b-95fb-e14ddaa311a2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 200 len: 1365 microversion: 2.1 time: 0.162564 May 16 20:41:48.188228 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 291/579] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:48 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:49.208946 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-317d1d26-612c-4d18-bd2a-3ad6f9635a02 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:49.209965 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-317d1d26-612c-4d18-bd2a-3ad6f9635a02 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:49.218754 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-317d1d26-612c-4d18-bd2a-3ad6f9635a02 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:49.219204 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-317d1d26-612c-4d18-bd2a-3ad6f9635a02 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:49.220012 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-317d1d26-612c-4d18-bd2a-3ad6f9635a02 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:49.220472 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-317d1d26-612c-4d18-bd2a-3ad6f9635a02 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:49.425403 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-317d1d26-612c-4d18-bd2a-3ad6f9635a02 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:49.437467 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-317d1d26-612c-4d18-bd2a-3ad6f9635a02 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 200 len: 1365 microversion: 2.1 time: 0.234840 May 16 20:41:49.438280 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 289/580] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:49 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:50.459596 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-b2368e1b-6413-4f20-ae4c-6650e2c4b712 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:50.460343 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-b2368e1b-6413-4f20-ae4c-6650e2c4b712 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:50.467254 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b2368e1b-6413-4f20-ae4c-6650e2c4b712 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:50.467709 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b2368e1b-6413-4f20-ae4c-6650e2c4b712 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:50.468493 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b2368e1b-6413-4f20-ae4c-6650e2c4b712 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:50.468953 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b2368e1b-6413-4f20-ae4c-6650e2c4b712 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:50.654050 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-b2368e1b-6413-4f20-ae4c-6650e2c4b712 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:50.661835 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-b2368e1b-6413-4f20-ae4c-6650e2c4b712 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 200 len: 1365 microversion: 2.1 time: 0.206166 May 16 20:41:50.662400 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 292/581] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:50 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:51.680302 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-6071cd01-8bfd-420b-a29f-5fdb5bc5f85d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:51.680949 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-6071cd01-8bfd-420b-a29f-5fdb5bc5f85d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:51.688076 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6071cd01-8bfd-420b-a29f-5fdb5bc5f85d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:51.688557 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6071cd01-8bfd-420b-a29f-5fdb5bc5f85d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:51.689328 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6071cd01-8bfd-420b-a29f-5fdb5bc5f85d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:51.689769 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6071cd01-8bfd-420b-a29f-5fdb5bc5f85d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:51.818897 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-6071cd01-8bfd-420b-a29f-5fdb5bc5f85d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:51.826441 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-6071cd01-8bfd-420b-a29f-5fdb5bc5f85d tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 200 len: 1365 microversion: 2.1 time: 0.150498 May 16 20:41:51.827022 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 290/582] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:51 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:52.092786 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-c6216590-2337-4bf3-808f-152ef75be4f5 req-5efff9d5-0f66-4089-975c-f1083df201da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faf5e096-bd76-45d5-a4cc-8a6c1cc08833", "name": "network-vif-plugged", "status": "completed", "tag": "7cecb240-68ee-4c56-b8b3-d62a8675bc86"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:41:52.102092 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-c6216590-2337-4bf3-808f-152ef75be4f5 req-5efff9d5-0f66-4089-975c-f1083df201da service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:52.102609 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-c6216590-2337-4bf3-808f-152ef75be4f5 req-5efff9d5-0f66-4089-975c-f1083df201da service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:52.114664 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-c6216590-2337-4bf3-808f-152ef75be4f5 req-5efff9d5-0f66-4089-975c-f1083df201da service nova] Creating event network-vif-plugged:7cecb240-68ee-4c56-b8b3-d62a8675bc86 for instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 on hv-cinder-77703 May 16 20:41:52.120632 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-c6216590-2337-4bf3-808f-152ef75be4f5 req-5efff9d5-0f66-4089-975c-f1083df201da service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031715 May 16 20:41:52.121511 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 293/583] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:41:52.855376 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0dc754a0-6cd3-4bc9-bc8d-0d7e3753b591 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:52.856309 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0dc754a0-6cd3-4bc9-bc8d-0d7e3753b591 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:52.867305 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0dc754a0-6cd3-4bc9-bc8d-0d7e3753b591 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:52.868024 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0dc754a0-6cd3-4bc9-bc8d-0d7e3753b591 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:52.869340 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0dc754a0-6cd3-4bc9-bc8d-0d7e3753b591 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:52.870061 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0dc754a0-6cd3-4bc9-bc8d-0d7e3753b591 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:52.998449 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-0dc754a0-6cd3-4bc9-bc8d-0d7e3753b591 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:53.006506 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0dc754a0-6cd3-4bc9-bc8d-0d7e3753b591 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 200 len: 1365 microversion: 2.1 time: 0.157692 May 16 20:41:53.007049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 291/584] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:52 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:54.036864 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6b4dda36-6d2e-4959-be25-09fac2108ae8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:54.037962 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-6b4dda36-6d2e-4959-be25-09fac2108ae8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:54.047138 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6b4dda36-6d2e-4959-be25-09fac2108ae8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:54.047826 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6b4dda36-6d2e-4959-be25-09fac2108ae8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:54.048635 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6b4dda36-6d2e-4959-be25-09fac2108ae8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:54.049334 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6b4dda36-6d2e-4959-be25-09fac2108ae8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:54.188091 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6b4dda36-6d2e-4959-be25-09fac2108ae8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:54.196051 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-6b4dda36-6d2e-4959-be25-09fac2108ae8 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 200 len: 1365 microversion: 2.1 time: 0.168673 May 16 20:41:54.196685 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 294/585] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:54 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:55.217140 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-585d6b2c-9dc6-4cca-85c5-238ec0955bd9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:55.218136 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-585d6b2c-9dc6-4cca-85c5-238ec0955bd9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:55.229005 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-585d6b2c-9dc6-4cca-85c5-238ec0955bd9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:55.229741 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-585d6b2c-9dc6-4cca-85c5-238ec0955bd9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:55.231057 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-585d6b2c-9dc6-4cca-85c5-238ec0955bd9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:55.231774 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-585d6b2c-9dc6-4cca-85c5-238ec0955bd9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:55.364189 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-585d6b2c-9dc6-4cca-85c5-238ec0955bd9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:41:55.372359 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-585d6b2c-9dc6-4cca-85c5-238ec0955bd9 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 200 len: 1556 microversion: 2.1 time: 0.161928 May 16 20:41:55.372971 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 292/586] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:41:55 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:41:55.388811 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-23592201-ee54-4221-9756-b770ebce7c6b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:41:55.389379 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-23592201-ee54-4221-9756-b770ebce7c6b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:41:55.396075 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-23592201-ee54-4221-9756-b770ebce7c6b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:55.396568 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-23592201-ee54-4221-9756-b770ebce7c6b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:55.397348 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-23592201-ee54-4221-9756-b770ebce7c6b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:55.397782 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-23592201-ee54-4221-9756-b770ebce7c6b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:55.478515 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-23592201-ee54-4221-9756-b770ebce7c6b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093609 May 16 20:41:55.479124 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 295/587] 10.222.0.49 () {58 vars in 1274 bytes} [Mon May 16 20:41:55 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:41:56.419567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-9403465a-4b49-4136-a2c4-a8fdbe8b7275 req-5545e7d7-756a-41f7-8171-98ad329b037a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faf5e096-bd76-45d5-a4cc-8a6c1cc08833", "tag": "7cecb240-68ee-4c56-b8b3-d62a8675bc86"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:41:56.428026 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-9403465a-4b49-4136-a2c4-a8fdbe8b7275 req-5545e7d7-756a-41f7-8171-98ad329b037a service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:41:56.428822 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-9403465a-4b49-4136-a2c4-a8fdbe8b7275 req-5545e7d7-756a-41f7-8171-98ad329b037a service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:41:56.439845 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-9403465a-4b49-4136-a2c4-a8fdbe8b7275 req-5545e7d7-756a-41f7-8171-98ad329b037a service nova] Creating event network-changed:7cecb240-68ee-4c56-b8b3-d62a8675bc86 for instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 on hv-cinder-77703 May 16 20:41:56.444786 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-9403465a-4b49-4136-a2c4-a8fdbe8b7275 req-5545e7d7-756a-41f7-8171-98ad329b037a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028927 May 16 20:41:56.446737 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 293/588] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:42:01.125930 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-bcc36b07-a6f1-4af8-af00-d771b813c982 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1467058716"}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:42:01.126587 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-bcc36b07-a6f1-4af8-af00-d771b813c982 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:01.133131 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bcc36b07-a6f1-4af8-af00-d771b813c982 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:01.133583 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bcc36b07-a6f1-4af8-af00-d771b813c982 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:01.134391 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bcc36b07-a6f1-4af8-af00-d771b813c982 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:01.134824 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bcc36b07-a6f1-4af8-af00-d771b813c982 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:01.265679 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.network.security_group_api [None req-bcc36b07-a6f1-4af8-af00-d771b813c982 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Removing security group 00182a1c-d58c-4057-acdd-fb28ba7844fe from port ebd68081-2a96-4732-bf76-3afb6eec8000 May 16 20:42:01.659265 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-bcc36b07-a6f1-4af8-af00-d771b813c982 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "POST /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f/action" status: 202 len: 0 microversion: 2.1 time: 0.538668 May 16 20:42:01.659879 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 296/589] 10.222.0.49 () {60 vars in 1277 bytes} [Mon May 16 20:42:01 2022] POST /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:42:01.672811 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-525c9a3d-2f64-4151-a0f2-4d54d38b2b40 req-36155b61-c123-4d35-ac67-a3b19d9cc82b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97c97db-14c0-47b5-b7dc-4a0fab17b32f", "tag": "ebd68081-2a96-4732-bf76-3afb6eec8000"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:42:01.688060 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-525c9a3d-2f64-4151-a0f2-4d54d38b2b40 req-36155b61-c123-4d35-ac67-a3b19d9cc82b service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:01.689045 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-525c9a3d-2f64-4151-a0f2-4d54d38b2b40 req-36155b61-c123-4d35-ac67-a3b19d9cc82b service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:01.703581 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-525c9a3d-2f64-4151-a0f2-4d54d38b2b40 req-36155b61-c123-4d35-ac67-a3b19d9cc82b service nova] Creating event network-changed:ebd68081-2a96-4732-bf76-3afb6eec8000 for instance f97c97db-14c0-47b5-b7dc-4a0fab17b32f on hv-cinder-77703 May 16 20:42:01.710653 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-525c9a3d-2f64-4151-a0f2-4d54d38b2b40 req-36155b61-c123-4d35-ac67-a3b19d9cc82b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042484 May 16 20:42:01.711714 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 294/590] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:42:02.833964 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-9120ff29-6a34-44ed-a7f2-37912fe124a2 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:02.834516 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-9120ff29-6a34-44ed-a7f2-37912fe124a2 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:02.841190 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9120ff29-6a34-44ed-a7f2-37912fe124a2 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:02.841715 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9120ff29-6a34-44ed-a7f2-37912fe124a2 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:02.842564 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9120ff29-6a34-44ed-a7f2-37912fe124a2 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:02.843082 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9120ff29-6a34-44ed-a7f2-37912fe124a2 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:02.932168 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.objects.instance [None req-9120ff29-6a34-44ed-a7f2-37912fe124a2 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lazy-loading 'services' on Instance uuid f97c97db-14c0-47b5-b7dc-4a0fab17b32f {{(pid=123564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:42:03.003873 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-9120ff29-6a34-44ed-a7f2-37912fe124a2 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f/os-volume_attachments/63b942a2-5959-4d39-86b3-e7ff162b03d5" status: 202 len: 0 microversion: 2.1 time: 0.174196 May 16 20:42:03.004718 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 297/591] 10.222.0.49 () {58 vars in 1415 bytes} [Mon May 16 20:42:02 2022] DELETE /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f/os-volume_attachments/63b942a2-5959-4d39-86b3-e7ff162b03d5 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:42:03.013756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-b8b6b5d9-2376-44e5-bc42-183994ec5e3a tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:03.014777 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-b8b6b5d9-2376-44e5-bc42-183994ec5e3a tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:03.021254 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b8b6b5d9-2376-44e5-bc42-183994ec5e3a tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:03.022075 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b8b6b5d9-2376-44e5-bc42-183994ec5e3a tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:03.023030 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b8b6b5d9-2376-44e5-bc42-183994ec5e3a tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:03.023707 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b8b6b5d9-2376-44e5-bc42-183994ec5e3a tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:03.057452 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-b8b6b5d9-2376-44e5-bc42-183994ec5e3a tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048011 May 16 20:42:03.058982 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 295/592] 10.222.0.49 () {58 vars in 1301 bytes} [Mon May 16 20:42:03 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:42:03.728125 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-28803e18-351d-4f86-bd25-1fc2332ca658 req-76b8abd7-8d44-456a-90ff-f7e1a1a945b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97c97db-14c0-47b5-b7dc-4a0fab17b32f", "tag": "ebd68081-2a96-4732-bf76-3afb6eec8000"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:42:03.737161 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-28803e18-351d-4f86-bd25-1fc2332ca658 req-76b8abd7-8d44-456a-90ff-f7e1a1a945b2 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:03.737611 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-28803e18-351d-4f86-bd25-1fc2332ca658 req-76b8abd7-8d44-456a-90ff-f7e1a1a945b2 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:03.749994 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-28803e18-351d-4f86-bd25-1fc2332ca658 req-76b8abd7-8d44-456a-90ff-f7e1a1a945b2 service nova] Creating event network-changed:ebd68081-2a96-4732-bf76-3afb6eec8000 for instance f97c97db-14c0-47b5-b7dc-4a0fab17b32f on hv-cinder-77703 May 16 20:42:03.754930 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-28803e18-351d-4f86-bd25-1fc2332ca658 req-76b8abd7-8d44-456a-90ff-f7e1a1a945b2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030911 May 16 20:42:03.755872 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 298/593] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:42:04.070222 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-38972e7f-0cd0-4383-b340-b8a027eef0c4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:04.071105 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-38972e7f-0cd0-4383-b340-b8a027eef0c4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:04.078015 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-38972e7f-0cd0-4383-b340-b8a027eef0c4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:04.078476 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-38972e7f-0cd0-4383-b340-b8a027eef0c4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:04.079257 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-38972e7f-0cd0-4383-b340-b8a027eef0c4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:04.079693 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-38972e7f-0cd0-4383-b340-b8a027eef0c4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:04.110813 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-38972e7f-0cd0-4383-b340-b8a027eef0c4 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044736 May 16 20:42:04.111607 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 296/594] 10.222.0.49 () {58 vars in 1301 bytes} [Mon May 16 20:42:04 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 20:42:04.123182 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-8fa0cae9-878d-447a-9e53-bbea03028834 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:04.123904 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-8fa0cae9-878d-447a-9e53-bbea03028834 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:04.130295 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-8fa0cae9-878d-447a-9e53-bbea03028834 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:04.130747 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-8fa0cae9-878d-447a-9e53-bbea03028834 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:04.131539 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-8fa0cae9-878d-447a-9e53-bbea03028834 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:04.131969 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-8fa0cae9-878d-447a-9e53-bbea03028834 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:04.210082 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-8fa0cae9-878d-447a-9e53-bbea03028834 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] HTTP exception thrown: Instance f97c97db-14c0-47b5-b7dc-4a0fab17b32f is not attached to volume 63b942a2-5959-4d39-86b3-e7ff162b03d5 May 16 20:42:04.223099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-8fa0cae9-878d-447a-9e53-bbea03028834 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Request method failure captured: May 16 20:42:04.223099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: DELETE /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f/os-volume_attachments/63b942a2-5959-4d39-86b3-e7ff162b03d5 HTTP/1.1 May 16 20:42:04.223099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:42:04.223099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:42:04.223099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:42:04.223099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:42:04.223099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:42:04.223099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:42:04.223099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:42:04.223099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:42:04.223099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrZ1I8eWc8hrdPMS14jtOOdIRbpa4UQtF_HnG_xPfLfCILQPYpWvJ4JKrk_Nr8U2Gm4NI49qN4FTJyEiphu9E1ttSZ0-qMK7t3WYA0Q60p6DTaladfgW-Kr-FgC4qNy7Btujxdd4xUX-ClSqwK-F8XB7yNG60W3pGByNnMIwuD96JEo May 16 20:42:04.223099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:42:04.223099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:42:04.223099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:42:04.223099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:42:04.223099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:42:04.223099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:42:04.223099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 1260ab72bfde4bc9b3ba657ea0c18f14 May 16 20:42:04.223099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-TestMinimumBasicScenario-468782420 May 16 20:42:04.223099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:42:04.223099 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:42:04.224916 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1260ab72bfde4bc9b3ba657ea0c18f14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1260ab72bfde4bc9b3ba657ea0c18f14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1260ab72bfde4bc9b3ba657ea0c18f14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1260ab72bfde4bc9b3ba657ea0c18f14"}]}] May 16 20:42:04.224916 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-TestMinimumBasicScenario-468782420 May 16 20:42:04.224916 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 1260ab72bfde4bc9b3ba657ea0c18f14 May 16 20:42:04.224916 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-TestMinimumBasicScenario-468782420 May 16 20:42:04.224916 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-TestMinimumBasicScenario-468782420-project May 16 20:42:04.224916 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:42:04.224916 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:42:04.224916 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: e173bf0464c84f61b0b8f8ec071b61a9 May 16 20:42:04.224916 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-TestMinimumBasicScenario-468782420-project May 16 20:42:04.224916 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:42:04.224916 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance f97c97db-14c0-47b5-b7dc-4a0fab17b32f is not attached to volume 63b942a2-5959-4d39-86b3-e7ff162b03d5 May 16 20:42:04.225778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'server_id': 'f97c97db-14c0-47b5-b7dc-4a0fab17b32f', 'id': '63b942a2-5959-4d39-86b3-e7ff162b03d5'} May 16 20:42:04.225778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:42:04.225778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:42:04.225778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 16 20:42:04.225778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 16 20:42:04.225778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 20:42:04.225778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 20:42:04.225778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 16 20:42:04.225778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 16 20:42:04.225778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 63b942a2-5959-4d39-86b3-e7ff162b03d5. May 16 20:42:04.225778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:04.225778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:42:04.225778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:04.225778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:42:04.225778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:42:04.225778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:42:04.225778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:42:04.225778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:42:04.225778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:42:04.227041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:42:04.227041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 16 20:42:04.227041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 16 20:42:04.227041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97c97db-14c0-47b5-b7dc-4a0fab17b32f is not attached to volume 63b942a2-5959-4d39-86b3-e7ff162b03d5 May 16 20:42:04.227041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:04.227041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:42:04.227041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:04.227041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:42:04.227041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:42:04.227041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:42:04.227041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:42:04.227041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:42:04.227041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97c97db-14c0-47b5-b7dc-4a0fab17b32f is not attached to volume 63b942a2-5959-4d39-86b3-e7ff162b03d5 May 16 20:42:04.227041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:04.227041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-8fa0cae9-878d-447a-9e53-bbea03028834 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Returning 404 to user: Instance f97c97db-14c0-47b5-b7dc-4a0fab17b32f is not attached to volume 63b942a2-5959-4d39-86b3-e7ff162b03d5 {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:42:04.228033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-8fa0cae9-878d-447a-9e53-bbea03028834 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f/os-volume_attachments/63b942a2-5959-4d39-86b3-e7ff162b03d5" status: 404 len: 154 microversion: 2.1 time: 0.106806 May 16 20:42:04.228033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 299/595] 10.222.0.49 () {58 vars in 1415 bytes} [Mon May 16 20:42:04 2022] DELETE /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f/os-volume_attachments/63b942a2-5959-4d39-86b3-e7ff162b03d5 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:42:04.341710 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-157004fa-556c-4f84-99fd-2a82c5a77a7f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:04.342215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-157004fa-556c-4f84-99fd-2a82c5a77a7f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:04.348208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-157004fa-556c-4f84-99fd-2a82c5a77a7f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:04.348681 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-157004fa-556c-4f84-99fd-2a82c5a77a7f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:04.349453 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-157004fa-556c-4f84-99fd-2a82c5a77a7f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:04.349890 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-157004fa-556c-4f84-99fd-2a82c5a77a7f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:04.372757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-157004fa-556c-4f84-99fd-2a82c5a77a7f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594/ips" status: 200 len: 151 microversion: 2.20 time: 0.093246 May 16 20:42:04.373324 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 297/596] 10.222.0.49 () {60 vars in 1288 bytes} [Mon May 16 20:42:04 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594/ips => generated 151 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 20:42:05.374706 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-dea8a367-ec6c-4ba1-81b9-c54f77104c99 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:05.375244 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-dea8a367-ec6c-4ba1-81b9-c54f77104c99 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:05.382148 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dea8a367-ec6c-4ba1-81b9-c54f77104c99 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:05.382603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dea8a367-ec6c-4ba1-81b9-c54f77104c99 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:05.383381 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dea8a367-ec6c-4ba1-81b9-c54f77104c99 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:05.383821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dea8a367-ec6c-4ba1-81b9-c54f77104c99 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:05.409685 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-dea8a367-ec6c-4ba1-81b9-c54f77104c99 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Going to try to terminate instance {{(pid=123564) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:42:05.497408 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-dea8a367-ec6c-4ba1-81b9-c54f77104c99 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 204 len: 0 microversion: 2.1 time: 0.126064 May 16 20:42:05.498208 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 300/597] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:42:05 2022] DELETE /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 20:42:05.507639 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-627a749e-310c-4d8b-9e5e-0121cfce3523 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:05.508256 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-627a749e-310c-4d8b-9e5e-0121cfce3523 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:05.514981 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-627a749e-310c-4d8b-9e5e-0121cfce3523 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:05.515678 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-627a749e-310c-4d8b-9e5e-0121cfce3523 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:05.516519 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-627a749e-310c-4d8b-9e5e-0121cfce3523 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:05.516970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-627a749e-310c-4d8b-9e5e-0121cfce3523 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:05.658912 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-627a749e-310c-4d8b-9e5e-0121cfce3523 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:05.667079 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-627a749e-310c-4d8b-9e5e-0121cfce3523 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1553 microversion: 2.1 time: 0.164366 May 16 20:42:05.667588 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 298/598] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:05 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:06.422976 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-fa8b14a1-90b2-442b-a98e-af9d5d4b6b60 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:42:06.423999 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-fa8b14a1-90b2-442b-a98e-af9d5d4b6b60 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:06.435251 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-fa8b14a1-90b2-442b-a98e-af9d5d4b6b60 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:06.435704 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-fa8b14a1-90b2-442b-a98e-af9d5d4b6b60 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:06.436496 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-fa8b14a1-90b2-442b-a98e-af9d5d4b6b60 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:06.436958 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-fa8b14a1-90b2-442b-a98e-af9d5d4b6b60 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:06.460024 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.objects.instance [None req-fa8b14a1-90b2-442b-a98e-af9d5d4b6b60 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lazy-loading 'flavor' on Instance uuid 1718fbf6-1460-443d-9fb4-815bf062c594 {{(pid=123564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:42:06.686020 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-48bb1771-000a-4bec-8316-4d130638cdbc tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:06.686574 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-48bb1771-000a-4bec-8316-4d130638cdbc tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:06.693243 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-48bb1771-000a-4bec-8316-4d130638cdbc tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:06.693684 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-48bb1771-000a-4bec-8316-4d130638cdbc tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:06.694456 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-48bb1771-000a-4bec-8316-4d130638cdbc tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:06.694905 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-48bb1771-000a-4bec-8316-4d130638cdbc tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:06.713643 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-fa8b14a1-90b2-442b-a98e-af9d5d4b6b60 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "POST /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594/action" status: 202 len: 0 microversion: 2.20 time: 0.297766 May 16 20:42:06.714268 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 301/599] 10.222.0.49 () {62 vars in 1318 bytes} [Mon May 16 20:42:06 2022] POST /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 20:42:06.724037 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-b5b5c898-6c71-415c-b811-2dd61601a39d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:06.724761 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-b5b5c898-6c71-415c-b811-2dd61601a39d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:06.731022 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b5b5c898-6c71-415c-b811-2dd61601a39d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:06.731469 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b5b5c898-6c71-415c-b811-2dd61601a39d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:06.732303 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b5b5c898-6c71-415c-b811-2dd61601a39d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:06.732782 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b5b5c898-6c71-415c-b811-2dd61601a39d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:06.875843 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-48bb1771-000a-4bec-8316-4d130638cdbc tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:06.884004 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-48bb1771-000a-4bec-8316-4d130638cdbc tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1553 microversion: 2.1 time: 0.202781 May 16 20:42:06.884817 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 299/600] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:06 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1553 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:42:06.902758 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-b5b5c898-6c71-415c-b811-2dd61601a39d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:06.910937 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-b5b5c898-6c71-415c-b811-2dd61601a39d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:06.912498 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-b5b5c898-6c71-415c-b811-2dd61601a39d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:06.913625 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-b5b5c898-6c71-415c-b811-2dd61601a39d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1723 microversion: 2.20 time: 0.194884 May 16 20:42:06.914346 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 302/601] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:06 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:42:07.904157 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-3d2dfeb2-a7c7-4c8a-b579-c24d1ce3a7ff tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:07.905033 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-3d2dfeb2-a7c7-4c8a-b579-c24d1ce3a7ff tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:07.913544 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3d2dfeb2-a7c7-4c8a-b579-c24d1ce3a7ff tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:07.914192 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3d2dfeb2-a7c7-4c8a-b579-c24d1ce3a7ff tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:07.915315 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3d2dfeb2-a7c7-4c8a-b579-c24d1ce3a7ff tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:07.915907 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3d2dfeb2-a7c7-4c8a-b579-c24d1ce3a7ff tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:07.932134 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-d730ffd9-445a-49b5-a5d3-031b8011a199 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:07.932858 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-d730ffd9-445a-49b5-a5d3-031b8011a199 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:07.940297 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d730ffd9-445a-49b5-a5d3-031b8011a199 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:07.940775 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d730ffd9-445a-49b5-a5d3-031b8011a199 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:07.941546 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d730ffd9-445a-49b5-a5d3-031b8011a199 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:07.942156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d730ffd9-445a-49b5-a5d3-031b8011a199 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:07.986229 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-3d2dfeb2-a7c7-4c8a-b579-c24d1ce3a7ff tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e173bf0464c84f61b0b8f8ec071b61a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1260ab72bfde4bc9b3ba657ea0c18f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:07.997678 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-3d2dfeb2-a7c7-4c8a-b579-c24d1ce3a7ff tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 200 len: 1511 microversion: 2.1 time: 0.099788 May 16 20:42:08.001013 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 300/602] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:07 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 1511 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:08.086726 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-d730ffd9-445a-49b5-a5d3-031b8011a199 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:08.095430 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-d730ffd9-445a-49b5-a5d3-031b8011a199 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:08.097015 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-d730ffd9-445a-49b5-a5d3-031b8011a199 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:08.098197 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-d730ffd9-445a-49b5-a5d3-031b8011a199 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1723 microversion: 2.20 time: 0.170693 May 16 20:42:08.103405 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 303/603] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:07 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:08.103962 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-8c31fb7f-2d6f-4e98-875a-ada6028360b0 req-8d6adc7d-d90a-4a99-af7f-4e34cef8105c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97c97db-14c0-47b5-b7dc-4a0fab17b32f", "name": "network-vif-deleted", "tag": "ebd68081-2a96-4732-bf76-3afb6eec8000"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:42:08.112690 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-8c31fb7f-2d6f-4e98-875a-ada6028360b0 req-8d6adc7d-d90a-4a99-af7f-4e34cef8105c service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:08.113353 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-8c31fb7f-2d6f-4e98-875a-ada6028360b0 req-8d6adc7d-d90a-4a99-af7f-4e34cef8105c service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:08.126285 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-8c31fb7f-2d6f-4e98-875a-ada6028360b0 req-8d6adc7d-d90a-4a99-af7f-4e34cef8105c service nova] Creating event network-vif-deleted:ebd68081-2a96-4732-bf76-3afb6eec8000 for instance f97c97db-14c0-47b5-b7dc-4a0fab17b32f on hv-cinder-77703 May 16 20:42:08.131907 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-8c31fb7f-2d6f-4e98-875a-ada6028360b0 req-8d6adc7d-d90a-4a99-af7f-4e34cef8105c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092795 May 16 20:42:08.132534 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 301/604] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:42:09.019856 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-dc8ce3a1-94c1-46cd-81a0-a74743da1eb3 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:09.020616 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-dc8ce3a1-94c1-46cd-81a0-a74743da1eb3 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] [instance: f97c97db-14c0-47b5-b7dc-4a0fab17b32f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:09.029565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dc8ce3a1-94c1-46cd-81a0-a74743da1eb3 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:09.029965 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dc8ce3a1-94c1-46cd-81a0-a74743da1eb3 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:09.030767 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dc8ce3a1-94c1-46cd-81a0-a74743da1eb3 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:09.031197 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dc8ce3a1-94c1-46cd-81a0-a74743da1eb3 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:09.044749 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-dc8ce3a1-94c1-46cd-81a0-a74743da1eb3 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] HTTP exception thrown: Instance f97c97db-14c0-47b5-b7dc-4a0fab17b32f could not be found. May 16 20:42:09.046505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-dc8ce3a1-94c1-46cd-81a0-a74743da1eb3 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Request method failure captured: May 16 20:42:09.046505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f HTTP/1.1 May 16 20:42:09.046505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:42:09.046505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:42:09.046505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:42:09.046505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:42:09.046505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:42:09.046505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:42:09.046505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:42:09.046505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:42:09.046505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrZ1I8eWc8hrdPMS14jtOOdIRbpa4UQtF_HnG_xPfLfCILQPYpWvJ4JKrk_Nr8U2Gm4NI49qN4FTJyEiphu9E1ttSZ0-qMK7t3WYA0Q60p6DTaladfgW-Kr-FgC4qNy7Btujxdd4xUX-ClSqwK-F8XB7yNG60W3pGByNnMIwuD96JEo May 16 20:42:09.046505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:42:09.046505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:42:09.046505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:42:09.046505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:42:09.046505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:42:09.046505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:42:09.046505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 1260ab72bfde4bc9b3ba657ea0c18f14 May 16 20:42:09.046505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-TestMinimumBasicScenario-468782420 May 16 20:42:09.046505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:42:09.046505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:42:09.048191 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1260ab72bfde4bc9b3ba657ea0c18f14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1260ab72bfde4bc9b3ba657ea0c18f14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1260ab72bfde4bc9b3ba657ea0c18f14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1260ab72bfde4bc9b3ba657ea0c18f14"}]}] May 16 20:42:09.048191 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-TestMinimumBasicScenario-468782420 May 16 20:42:09.048191 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 1260ab72bfde4bc9b3ba657ea0c18f14 May 16 20:42:09.048191 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-TestMinimumBasicScenario-468782420 May 16 20:42:09.048191 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-TestMinimumBasicScenario-468782420-project May 16 20:42:09.048191 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:42:09.048191 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:42:09.048191 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: e173bf0464c84f61b0b8f8ec071b61a9 May 16 20:42:09.048191 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-TestMinimumBasicScenario-468782420-project May 16 20:42:09.048191 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:42:09.048191 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance f97c97db-14c0-47b5-b7dc-4a0fab17b32f could not be found. May 16 20:42:09.048191 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': 'f97c97db-14c0-47b5-b7dc-4a0fab17b32f'} May 16 20:42:09.049025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:42:09.049025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:42:09.049025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:42:09.049025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:42:09.049025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:42:09.049025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:42:09.049025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:42:09.049025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:42:09.049025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:42:09.049025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:42:09.049025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f97c97db-14c0-47b5-b7dc-4a0fab17b32f could not be found. May 16 20:42:09.049025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:09.049025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:42:09.049025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:09.049025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:42:09.049025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:42:09.049025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:42:09.049025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:42:09.049025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:42:09.049025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:42:09.050399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:42:09.050399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:42:09.050399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:42:09.050399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:42:09.050399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:42:09.050399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:42:09.050399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:42:09.050399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97c97db-14c0-47b5-b7dc-4a0fab17b32f could not be found. May 16 20:42:09.050399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:09.050399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:42:09.050399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:09.050399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:42:09.050399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:42:09.050399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:42:09.050399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:42:09.050399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:42:09.050399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97c97db-14c0-47b5-b7dc-4a0fab17b32f could not be found. May 16 20:42:09.050399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:09.051759 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-dc8ce3a1-94c1-46cd-81a0-a74743da1eb3 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Returning 404 to user: Instance f97c97db-14c0-47b5-b7dc-4a0fab17b32f could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:42:09.051759 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-dc8ce3a1-94c1-46cd-81a0-a74743da1eb3 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f" status: 404 len: 111 microversion: 2.1 time: 0.033437 May 16 20:42:09.051759 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 304/605] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:09 2022] GET /compute/v2.1/servers/f97c97db-14c0-47b5-b7dc-4a0fab17b32f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:42:09.058058 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-9d2087bc-6b81-4b70-8fd1-8aaffdef2962 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] Calling method '.version_select at 0x7f81b121dd30>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:09.078755 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-9d2087bc-6b81-4b70-8fd1-8aaffdef2962 tempest-TestMinimumBasicScenario-468782420 tempest-TestMinimumBasicScenario-468782420-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-617396179" status: 202 len: 0 microversion: 2.1 time: 0.025638 May 16 20:42:09.079351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 302/606] 10.222.0.49 () {58 vars in 1268 bytes} [Mon May 16 20:42:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-617396179 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:42:09.121568 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6ca2d592-202d-4968-9f07-1dda21ecae2a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:09.122176 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-6ca2d592-202d-4968-9f07-1dda21ecae2a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:09.129054 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6ca2d592-202d-4968-9f07-1dda21ecae2a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:09.129679 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6ca2d592-202d-4968-9f07-1dda21ecae2a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:09.130547 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6ca2d592-202d-4968-9f07-1dda21ecae2a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:09.130984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6ca2d592-202d-4968-9f07-1dda21ecae2a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:09.266588 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6ca2d592-202d-4968-9f07-1dda21ecae2a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:09.274745 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6ca2d592-202d-4968-9f07-1dda21ecae2a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:09.276243 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6ca2d592-202d-4968-9f07-1dda21ecae2a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:09.277445 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-6ca2d592-202d-4968-9f07-1dda21ecae2a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1723 microversion: 2.20 time: 0.160414 May 16 20:42:09.277998 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 305/607] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:09 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:10.295658 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-ab7de792-56b0-4478-8ae6-2b1238500d3a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:10.296384 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-ab7de792-56b0-4478-8ae6-2b1238500d3a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:10.304201 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ab7de792-56b0-4478-8ae6-2b1238500d3a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:10.304691 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ab7de792-56b0-4478-8ae6-2b1238500d3a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:10.305467 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ab7de792-56b0-4478-8ae6-2b1238500d3a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:10.305904 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ab7de792-56b0-4478-8ae6-2b1238500d3a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:10.439222 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ab7de792-56b0-4478-8ae6-2b1238500d3a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:10.447190 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ab7de792-56b0-4478-8ae6-2b1238500d3a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:10.448776 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ab7de792-56b0-4478-8ae6-2b1238500d3a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:10.449949 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-ab7de792-56b0-4478-8ae6-2b1238500d3a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1723 microversion: 2.20 time: 0.158524 May 16 20:42:10.450517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 303/608] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:10 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:11.468623 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6dd5d439-88b0-458c-9fa9-ed297b0774c4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:11.469504 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-6dd5d439-88b0-458c-9fa9-ed297b0774c4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:11.476300 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6dd5d439-88b0-458c-9fa9-ed297b0774c4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:11.476696 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6dd5d439-88b0-458c-9fa9-ed297b0774c4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:11.477616 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6dd5d439-88b0-458c-9fa9-ed297b0774c4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:11.478027 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6dd5d439-88b0-458c-9fa9-ed297b0774c4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:11.694564 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6dd5d439-88b0-458c-9fa9-ed297b0774c4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:11.703301 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6dd5d439-88b0-458c-9fa9-ed297b0774c4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:11.704916 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6dd5d439-88b0-458c-9fa9-ed297b0774c4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:11.706164 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-6dd5d439-88b0-458c-9fa9-ed297b0774c4 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1723 microversion: 2.20 time: 0.241672 May 16 20:42:11.706810 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 306/609] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:11 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:12.724684 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0de36922-3f3d-452d-a148-ab31519e9331 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:12.725305 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0de36922-3f3d-452d-a148-ab31519e9331 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:12.731873 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0de36922-3f3d-452d-a148-ab31519e9331 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:12.732367 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0de36922-3f3d-452d-a148-ab31519e9331 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:12.733174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0de36922-3f3d-452d-a148-ab31519e9331 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:12.733606 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0de36922-3f3d-452d-a148-ab31519e9331 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:12.864954 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-0de36922-3f3d-452d-a148-ab31519e9331 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:12.873013 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-0de36922-3f3d-452d-a148-ab31519e9331 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:12.874573 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-0de36922-3f3d-452d-a148-ab31519e9331 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:12.875775 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0de36922-3f3d-452d-a148-ab31519e9331 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1723 microversion: 2.20 time: 0.155104 May 16 20:42:12.876733 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 304/610] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:12 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:13.895019 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-86845cf9-a0fe-490f-b119-287feea8fe95 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:13.896276 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-86845cf9-a0fe-490f-b119-287feea8fe95 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:13.903802 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-86845cf9-a0fe-490f-b119-287feea8fe95 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:13.904229 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-86845cf9-a0fe-490f-b119-287feea8fe95 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:13.905074 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-86845cf9-a0fe-490f-b119-287feea8fe95 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:13.905472 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-86845cf9-a0fe-490f-b119-287feea8fe95 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:14.031460 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-86845cf9-a0fe-490f-b119-287feea8fe95 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:14.039430 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-86845cf9-a0fe-490f-b119-287feea8fe95 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:14.041005 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-86845cf9-a0fe-490f-b119-287feea8fe95 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:14.043210 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-86845cf9-a0fe-490f-b119-287feea8fe95 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1723 microversion: 2.20 time: 0.151971 May 16 20:42:14.043775 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 307/611] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:13 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:15.061844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-43742a8d-d146-4533-9b50-09dbfa8d17d7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:15.062461 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-43742a8d-d146-4533-9b50-09dbfa8d17d7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:15.069114 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-43742a8d-d146-4533-9b50-09dbfa8d17d7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:15.069552 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-43742a8d-d146-4533-9b50-09dbfa8d17d7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:15.070322 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-43742a8d-d146-4533-9b50-09dbfa8d17d7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:15.070744 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-43742a8d-d146-4533-9b50-09dbfa8d17d7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:15.276992 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-43742a8d-d146-4533-9b50-09dbfa8d17d7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:15.285877 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-43742a8d-d146-4533-9b50-09dbfa8d17d7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:15.287381 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-43742a8d-d146-4533-9b50-09dbfa8d17d7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:15.289790 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-43742a8d-d146-4533-9b50-09dbfa8d17d7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1723 microversion: 2.20 time: 0.230699 May 16 20:42:15.300684 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 305/612] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:15 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:15.936084 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-540bb8f0-386f-4224-a063-f63760fcb877 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:15.936913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-540bb8f0-386f-4224-a063-f63760fcb877 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:15.942940 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-540bb8f0-386f-4224-a063-f63760fcb877 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:15.943392 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-540bb8f0-386f-4224-a063-f63760fcb877 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:15.944175 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-540bb8f0-386f-4224-a063-f63760fcb877 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:15.944640 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-540bb8f0-386f-4224-a063-f63760fcb877 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:16.044991 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.objects.instance [None req-540bb8f0-386f-4224-a063-f63760fcb877 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lazy-loading 'services' on Instance uuid dc01c3eb-3650-4295-b423-03ff2d49e945 {{(pid=123564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:42:16.121271 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-540bb8f0-386f-4224-a063-f63760fcb877 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945/os-volume_attachments/0ca9d73c-53ef-484c-a1c8-1448a967bb83" status: 202 len: 0 microversion: 2.1 time: 0.188994 May 16 20:42:16.122522 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 308/613] 10.222.0.49 () {58 vars in 1415 bytes} [Mon May 16 20:42:15 2022] DELETE /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945/os-volume_attachments/0ca9d73c-53ef-484c-a1c8-1448a967bb83 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:42:16.130852 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-5e9dfd4b-a6b0-495e-9449-c3a159dc625f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:16.132760 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-5e9dfd4b-a6b0-495e-9449-c3a159dc625f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:16.139659 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5e9dfd4b-a6b0-495e-9449-c3a159dc625f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:16.140407 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5e9dfd4b-a6b0-495e-9449-c3a159dc625f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:16.142063 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5e9dfd4b-a6b0-495e-9449-c3a159dc625f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:16.142551 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5e9dfd4b-a6b0-495e-9449-c3a159dc625f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:16.188115 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-5e9dfd4b-a6b0-495e-9449-c3a159dc625f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061294 May 16 20:42:16.188739 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 306/614] 10.222.0.49 () {58 vars in 1301 bytes} [Mon May 16 20:42:16 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:42:16.308801 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-2bc0a949-e6d4-4ae8-a6e2-fa21e32e7f30 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:16.309488 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-2bc0a949-e6d4-4ae8-a6e2-fa21e32e7f30 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:16.315802 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2bc0a949-e6d4-4ae8-a6e2-fa21e32e7f30 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:16.316248 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2bc0a949-e6d4-4ae8-a6e2-fa21e32e7f30 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:16.317147 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2bc0a949-e6d4-4ae8-a6e2-fa21e32e7f30 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:16.317576 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2bc0a949-e6d4-4ae8-a6e2-fa21e32e7f30 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:16.486241 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2bc0a949-e6d4-4ae8-a6e2-fa21e32e7f30 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:16.499059 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2bc0a949-e6d4-4ae8-a6e2-fa21e32e7f30 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:16.500592 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2bc0a949-e6d4-4ae8-a6e2-fa21e32e7f30 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:16.501891 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-2bc0a949-e6d4-4ae8-a6e2-fa21e32e7f30 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1723 microversion: 2.20 time: 0.197866 May 16 20:42:16.507443 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 309/615] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:16 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:17.200671 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-c6b46a07-97a3-4658-9367-0973f53b7d5f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:17.201608 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-c6b46a07-97a3-4658-9367-0973f53b7d5f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:17.210827 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c6b46a07-97a3-4658-9367-0973f53b7d5f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:17.211283 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c6b46a07-97a3-4658-9367-0973f53b7d5f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:17.212273 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c6b46a07-97a3-4658-9367-0973f53b7d5f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:17.213115 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c6b46a07-97a3-4658-9367-0973f53b7d5f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:17.253784 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-c6b46a07-97a3-4658-9367-0973f53b7d5f tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058103 May 16 20:42:17.254993 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 307/616] 10.222.0.49 () {58 vars in 1301 bytes} [Mon May 16 20:42:17 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 20:42:17.332954 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-96f8f533-ce92-4a69-99d6-3cfdbb7c7951 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:17.333545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-96f8f533-ce92-4a69-99d6-3cfdbb7c7951 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:17.341665 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-96f8f533-ce92-4a69-99d6-3cfdbb7c7951 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:17.342125 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-96f8f533-ce92-4a69-99d6-3cfdbb7c7951 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:17.342927 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-96f8f533-ce92-4a69-99d6-3cfdbb7c7951 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:17.343557 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-96f8f533-ce92-4a69-99d6-3cfdbb7c7951 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:17.372724 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-96f8f533-ce92-4a69-99d6-3cfdbb7c7951 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Going to try to terminate instance {{(pid=123564) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:42:17.454435 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-96f8f533-ce92-4a69-99d6-3cfdbb7c7951 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 204 len: 0 microversion: 2.1 time: 0.125278 May 16 20:42:17.454950 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 310/617] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:42:17 2022] DELETE /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 20:42:17.463069 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-d244e574-d4d8-4cc4-a782-99777347fe26 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:17.463677 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-d244e574-d4d8-4cc4-a782-99777347fe26 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:17.470000 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d244e574-d4d8-4cc4-a782-99777347fe26 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:17.470445 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d244e574-d4d8-4cc4-a782-99777347fe26 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:17.471226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d244e574-d4d8-4cc4-a782-99777347fe26 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:17.471666 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d244e574-d4d8-4cc4-a782-99777347fe26 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:17.525544 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-3c9f0767-5ab3-428b-adf5-5e397af5182c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:17.526242 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-3c9f0767-5ab3-428b-adf5-5e397af5182c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:17.532901 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3c9f0767-5ab3-428b-adf5-5e397af5182c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:17.533349 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3c9f0767-5ab3-428b-adf5-5e397af5182c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:17.534120 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3c9f0767-5ab3-428b-adf5-5e397af5182c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:17.534550 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3c9f0767-5ab3-428b-adf5-5e397af5182c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:17.641739 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d244e574-d4d8-4cc4-a782-99777347fe26 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:17.652160 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-d244e574-d4d8-4cc4-a782-99777347fe26 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1689 microversion: 2.1 time: 0.192838 May 16 20:42:17.653236 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 308/618] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:17 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1689 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:17.689538 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3c9f0767-5ab3-428b-adf5-5e397af5182c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:17.697283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3c9f0767-5ab3-428b-adf5-5e397af5182c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:17.698755 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3c9f0767-5ab3-428b-adf5-5e397af5182c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:17.699910 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-3c9f0767-5ab3-428b-adf5-5e397af5182c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1723 microversion: 2.20 time: 0.178731 May 16 20:42:17.700487 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 311/619] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:17 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:42:18.669760 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-b5bf9783-165b-41ec-aa43-8ffbaba3ab4b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:18.670371 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-b5bf9783-165b-41ec-aa43-8ffbaba3ab4b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:18.677178 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b5bf9783-165b-41ec-aa43-8ffbaba3ab4b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:18.677617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b5bf9783-165b-41ec-aa43-8ffbaba3ab4b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:18.678377 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b5bf9783-165b-41ec-aa43-8ffbaba3ab4b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:18.678799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b5bf9783-165b-41ec-aa43-8ffbaba3ab4b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:18.717152 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-65d3f90f-93b5-4316-a5e7-983fdc19ca50 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:18.717853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-65d3f90f-93b5-4316-a5e7-983fdc19ca50 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:18.725204 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-65d3f90f-93b5-4316-a5e7-983fdc19ca50 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:18.725753 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-65d3f90f-93b5-4316-a5e7-983fdc19ca50 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:18.726604 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-65d3f90f-93b5-4316-a5e7-983fdc19ca50 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:18.727130 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-65d3f90f-93b5-4316-a5e7-983fdc19ca50 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:18.865541 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-b5bf9783-165b-41ec-aa43-8ffbaba3ab4b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:18.873513 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-b5bf9783-165b-41ec-aa43-8ffbaba3ab4b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1689 microversion: 2.1 time: 0.207714 May 16 20:42:18.874072 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 309/620] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:18 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1689 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:18.897182 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-65d3f90f-93b5-4316-a5e7-983fdc19ca50 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:18.907729 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-65d3f90f-93b5-4316-a5e7-983fdc19ca50 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:18.909250 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-65d3f90f-93b5-4316-a5e7-983fdc19ca50 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:18.910413 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-65d3f90f-93b5-4316-a5e7-983fdc19ca50 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1723 microversion: 2.20 time: 0.197232 May 16 20:42:18.910984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 312/621] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:18 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:19.894862 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-66b91342-8aca-42dc-b842-c6d1163d26fd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:19.895954 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-66b91342-8aca-42dc-b842-c6d1163d26fd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:19.906620 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-66b91342-8aca-42dc-b842-c6d1163d26fd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:19.907369 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-66b91342-8aca-42dc-b842-c6d1163d26fd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:19.908684 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-66b91342-8aca-42dc-b842-c6d1163d26fd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:19.909395 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-66b91342-8aca-42dc-b842-c6d1163d26fd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:19.927837 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-74bc0cd5-b1df-4279-a18d-38d34c6994df tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:19.928325 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-74bc0cd5-b1df-4279-a18d-38d34c6994df tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:19.935690 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-74bc0cd5-b1df-4279-a18d-38d34c6994df tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:19.936142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-74bc0cd5-b1df-4279-a18d-38d34c6994df tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:19.936954 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-74bc0cd5-b1df-4279-a18d-38d34c6994df tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:19.937387 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-74bc0cd5-b1df-4279-a18d-38d34c6994df tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:20.096887 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-66b91342-8aca-42dc-b842-c6d1163d26fd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:20.105007 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-66b91342-8aca-42dc-b842-c6d1163d26fd tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1689 microversion: 2.1 time: 0.216727 May 16 20:42:20.105568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 310/622] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:19 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1689 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:20.107581 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-74bc0cd5-b1df-4279-a18d-38d34c6994df tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:20.115606 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-74bc0cd5-b1df-4279-a18d-38d34c6994df tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:20.117221 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-74bc0cd5-b1df-4279-a18d-38d34c6994df tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:20.118752 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-74bc0cd5-b1df-4279-a18d-38d34c6994df tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1723 microversion: 2.20 time: 0.194663 May 16 20:42:20.119536 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 313/623] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:19 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:21.122989 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0bfae27c-3cdc-495e-aef3-b58b0375191b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:21.123756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0bfae27c-3cdc-495e-aef3-b58b0375191b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:21.130593 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0bfae27c-3cdc-495e-aef3-b58b0375191b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:21.131037 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0bfae27c-3cdc-495e-aef3-b58b0375191b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:21.132699 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0bfae27c-3cdc-495e-aef3-b58b0375191b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:21.132699 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0bfae27c-3cdc-495e-aef3-b58b0375191b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:21.137946 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-d8ddda4c-8330-4299-b1e7-fb875fb7772d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:21.138535 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-d8ddda4c-8330-4299-b1e7-fb875fb7772d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:21.145338 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d8ddda4c-8330-4299-b1e7-fb875fb7772d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:21.145862 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d8ddda4c-8330-4299-b1e7-fb875fb7772d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:21.147212 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d8ddda4c-8330-4299-b1e7-fb875fb7772d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:21.147212 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d8ddda4c-8330-4299-b1e7-fb875fb7772d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:21.326073 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-0bfae27c-3cdc-495e-aef3-b58b0375191b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:21.333530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-d8ddda4c-8330-4299-b1e7-fb875fb7772d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:21.333691 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0bfae27c-3cdc-495e-aef3-b58b0375191b tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1689 microversion: 2.1 time: 0.215186 May 16 20:42:21.334153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 311/624] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:21 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1689 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:21.342770 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-d8ddda4c-8330-4299-b1e7-fb875fb7772d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:21.344473 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-d8ddda4c-8330-4299-b1e7-fb875fb7772d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:21.345797 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-d8ddda4c-8330-4299-b1e7-fb875fb7772d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1723 microversion: 2.20 time: 0.211725 May 16 20:42:21.346430 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 314/625] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:21 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:21.884910 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-4f070647-1eac-482f-861e-a0545f0b6524 req-4e059fa0-a392-4f58-a2d5-bc4d20b970bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc01c3eb-3650-4295-b423-03ff2d49e945", "name": "network-vif-deleted", "tag": "c9ce98a3-3d13-4c84-9fe3-9b633c649795"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:42:21.892959 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-4f070647-1eac-482f-861e-a0545f0b6524 req-4e059fa0-a392-4f58-a2d5-bc4d20b970bd service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:21.893378 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-4f070647-1eac-482f-861e-a0545f0b6524 req-4e059fa0-a392-4f58-a2d5-bc4d20b970bd service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:21.904707 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-4f070647-1eac-482f-861e-a0545f0b6524 req-4e059fa0-a392-4f58-a2d5-bc4d20b970bd service nova] Creating event network-vif-deleted:c9ce98a3-3d13-4c84-9fe3-9b633c649795 for instance dc01c3eb-3650-4295-b423-03ff2d49e945 on hv-cinder-77703 May 16 20:42:21.910099 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-4f070647-1eac-482f-861e-a0545f0b6524 req-4e059fa0-a392-4f58-a2d5-bc4d20b970bd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029021 May 16 20:42:21.911105 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 312/626] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:42:22.351062 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-52841447-8475-47d9-a56f-067b0a92daf4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:22.353165 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-52841447-8475-47d9-a56f-067b0a92daf4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:22.362546 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-52841447-8475-47d9-a56f-067b0a92daf4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:22.362994 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-52841447-8475-47d9-a56f-067b0a92daf4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:22.364054 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-52841447-8475-47d9-a56f-067b0a92daf4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:22.364514 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-52841447-8475-47d9-a56f-067b0a92daf4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:22.366960 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-84d76df3-60d0-4aa5-8f50-ecac5b10391a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:22.368562 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-84d76df3-60d0-4aa5-8f50-ecac5b10391a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:22.378045 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-84d76df3-60d0-4aa5-8f50-ecac5b10391a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:22.379008 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-84d76df3-60d0-4aa5-8f50-ecac5b10391a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:22.379963 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-84d76df3-60d0-4aa5-8f50-ecac5b10391a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:22.380526 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-84d76df3-60d0-4aa5-8f50-ecac5b10391a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:22.409146 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-52841447-8475-47d9-a56f-067b0a92daf4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:22.409585 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-52841447-8475-47d9-a56f-067b0a92daf4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:22.410028 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.objects.instance [None req-52841447-8475-47d9-a56f-067b0a92daf4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lazy-loading 'fault' on Instance uuid dc01c3eb-3650-4295-b423-03ff2d49e945 {{(pid=123564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:42:22.475092 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-52841447-8475-47d9-a56f-067b0a92daf4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:22.485459 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-52841447-8475-47d9-a56f-067b0a92daf4 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 200 len: 1334 microversion: 2.1 time: 0.138138 May 16 20:42:22.486113 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 315/627] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:22 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 1334 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:22.545105 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-84d76df3-60d0-4aa5-8f50-ecac5b10391a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:22.553268 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-84d76df3-60d0-4aa5-8f50-ecac5b10391a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:22.555124 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-84d76df3-60d0-4aa5-8f50-ecac5b10391a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:22.556325 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-84d76df3-60d0-4aa5-8f50-ecac5b10391a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1723 microversion: 2.20 time: 0.196908 May 16 20:42:22.557016 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 313/628] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:22 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:23.502793 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-9263db3f-0ce8-4b00-b7fb-3ce93def91c1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:23.503403 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-9263db3f-0ce8-4b00-b7fb-3ce93def91c1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: dc01c3eb-3650-4295-b423-03ff2d49e945] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:23.510172 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9263db3f-0ce8-4b00-b7fb-3ce93def91c1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:23.510649 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9263db3f-0ce8-4b00-b7fb-3ce93def91c1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:23.511489 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9263db3f-0ce8-4b00-b7fb-3ce93def91c1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:23.511922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9263db3f-0ce8-4b00-b7fb-3ce93def91c1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:23.526044 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-9263db3f-0ce8-4b00-b7fb-3ce93def91c1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] HTTP exception thrown: Instance dc01c3eb-3650-4295-b423-03ff2d49e945 could not be found. May 16 20:42:23.527672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-9263db3f-0ce8-4b00-b7fb-3ce93def91c1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Request method failure captured: May 16 20:42:23.527672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 HTTP/1.1 May 16 20:42:23.527672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:42:23.527672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:42:23.527672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:42:23.527672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:42:23.527672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:42:23.527672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:42:23.527672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:42:23.527672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:42:23.527672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrYz-yjVKwgSFfN0eLNagUyRjDkS79jG85WNDPi_wT024qE-ANQLmJ-KHEJ6Vnv8ngmMt0zEUKEE8CtESkh62DxmHenCL5YAhZjLMoCaFCWuXPk0rDXBZ7EBJ6W3SjHCtjbuNDPg0vhkDGdSnh6SHKwG6VwkTaeY6mnwE6Exhy0aLX0 May 16 20:42:23.527672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:42:23.527672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:42:23.527672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:42:23.527672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:42:23.527672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:42:23.527672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:42:23.527672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 69e39fae43c341798f00e3b48f20d003 May 16 20:42:23.527672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1585639724 May 16 20:42:23.527672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:42:23.527672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:42:23.529124 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_69e39fae43c341798f00e3b48f20d003"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e39fae43c341798f00e3b48f20d003"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/69e39fae43c341798f00e3b48f20d003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e39fae43c341798f00e3b48f20d003"}]}] May 16 20:42:23.529124 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1585639724 May 16 20:42:23.529124 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 69e39fae43c341798f00e3b48f20d003 May 16 20:42:23.529124 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1585639724 May 16 20:42:23.529124 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-ServerRescueNegativeTestJSON-1585639724-project May 16 20:42:23.529124 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:42:23.529124 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:42:23.529124 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: 20c57f1318cd4c73b2248b2d02896176 May 16 20:42:23.529124 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1585639724-project May 16 20:42:23.529124 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:42:23.529124 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance dc01c3eb-3650-4295-b423-03ff2d49e945 could not be found. May 16 20:42:23.529124 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': 'dc01c3eb-3650-4295-b423-03ff2d49e945'} May 16 20:42:23.529973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:42:23.529973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:42:23.529973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:42:23.529973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:42:23.529973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:42:23.529973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:42:23.529973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:42:23.529973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:42:23.529973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:42:23.529973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:42:23.529973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc01c3eb-3650-4295-b423-03ff2d49e945 could not be found. May 16 20:42:23.529973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:23.529973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:42:23.529973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:23.529973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:42:23.529973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:42:23.529973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:42:23.529973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:42:23.529973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:42:23.529973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:42:23.531412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:42:23.531412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:42:23.531412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:42:23.531412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:42:23.531412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:42:23.531412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:42:23.531412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:42:23.531412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc01c3eb-3650-4295-b423-03ff2d49e945 could not be found. May 16 20:42:23.531412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:23.531412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:42:23.531412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:23.531412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:42:23.531412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:42:23.531412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:42:23.531412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:42:23.531412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:42:23.531412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc01c3eb-3650-4295-b423-03ff2d49e945 could not be found. May 16 20:42:23.531412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:23.532889 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-9263db3f-0ce8-4b00-b7fb-3ce93def91c1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Returning 404 to user: Instance dc01c3eb-3650-4295-b423-03ff2d49e945 could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:42:23.532889 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-9263db3f-0ce8-4b00-b7fb-3ce93def91c1 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945" status: 404 len: 111 microversion: 2.1 time: 0.030345 May 16 20:42:23.532889 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 316/629] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:23 2022] GET /compute/v2.1/servers/dc01c3eb-3650-4295-b423-03ff2d49e945 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:42:23.538862 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-6f930832-247b-4847-a80a-be73759114f3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '.version_select at 0x7f81b11c7d30>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:23.560046 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-6f930832-247b-4847-a80a-be73759114f3 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-772041213" status: 202 len: 0 microversion: 2.1 time: 0.025954 May 16 20:42:23.560655 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 314/630] 10.222.0.49 () {58 vars in 1217 bytes} [Mon May 16 20:42:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-772041213 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:42:23.574759 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-4f5ca8ef-2546-4452-850a-b48c6143b00c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:23.575368 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-4f5ca8ef-2546-4452-850a-b48c6143b00c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:23.582078 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4f5ca8ef-2546-4452-850a-b48c6143b00c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:23.582525 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4f5ca8ef-2546-4452-850a-b48c6143b00c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:23.583285 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4f5ca8ef-2546-4452-850a-b48c6143b00c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:23.583781 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4f5ca8ef-2546-4452-850a-b48c6143b00c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:23.763838 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-4f5ca8ef-2546-4452-850a-b48c6143b00c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:23.773945 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-4f5ca8ef-2546-4452-850a-b48c6143b00c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:23.777162 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-4f5ca8ef-2546-4452-850a-b48c6143b00c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:23.777162 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-4f5ca8ef-2546-4452-850a-b48c6143b00c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1744 microversion: 2.20 time: 0.206101 May 16 20:42:23.787986 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 317/631] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:23 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1744 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:24.799460 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-122419d3-bb43-44fe-9d23-3719544efa7e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:24.800522 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-122419d3-bb43-44fe-9d23-3719544efa7e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:24.812243 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-122419d3-bb43-44fe-9d23-3719544efa7e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:24.812716 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-122419d3-bb43-44fe-9d23-3719544efa7e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:24.813498 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-122419d3-bb43-44fe-9d23-3719544efa7e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:24.813901 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-122419d3-bb43-44fe-9d23-3719544efa7e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:24.951318 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-122419d3-bb43-44fe-9d23-3719544efa7e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:24.959673 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-122419d3-bb43-44fe-9d23-3719544efa7e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:24.961182 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-122419d3-bb43-44fe-9d23-3719544efa7e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:24.962344 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-122419d3-bb43-44fe-9d23-3719544efa7e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1744 microversion: 2.20 time: 0.169616 May 16 20:42:24.962899 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 315/632] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:24 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:25.980455 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-49d26c69-6836-42a3-b8d8-d65002b13e86 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:25.981281 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-49d26c69-6836-42a3-b8d8-d65002b13e86 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:25.988746 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-49d26c69-6836-42a3-b8d8-d65002b13e86 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:25.989501 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-49d26c69-6836-42a3-b8d8-d65002b13e86 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:25.990532 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-49d26c69-6836-42a3-b8d8-d65002b13e86 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:25.991190 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-49d26c69-6836-42a3-b8d8-d65002b13e86 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:26.136399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-49d26c69-6836-42a3-b8d8-d65002b13e86 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:26.145049 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-49d26c69-6836-42a3-b8d8-d65002b13e86 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:26.147954 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-49d26c69-6836-42a3-b8d8-d65002b13e86 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:26.149323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-49d26c69-6836-42a3-b8d8-d65002b13e86 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1739 microversion: 2.20 time: 0.172825 May 16 20:42:26.150166 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 318/633] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:25 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:26.386025 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-b0870d34-55ce-4f9f-8cb3-1c164cea645d req-dffae37b-ee7c-450a-a421-250a1862d574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1718fbf6-1460-443d-9fb4-815bf062c594", "name": "network-vif-plugged", "status": "completed", "tag": "21b40ca4-40ac-4a3f-9958-fe3007671e02"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:42:26.397001 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-b0870d34-55ce-4f9f-8cb3-1c164cea645d req-dffae37b-ee7c-450a-a421-250a1862d574 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:26.397712 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-b0870d34-55ce-4f9f-8cb3-1c164cea645d req-dffae37b-ee7c-450a-a421-250a1862d574 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:26.413610 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-b0870d34-55ce-4f9f-8cb3-1c164cea645d req-dffae37b-ee7c-450a-a421-250a1862d574 service nova] Creating event network-vif-plugged:21b40ca4-40ac-4a3f-9958-fe3007671e02 for instance 1718fbf6-1460-443d-9fb4-815bf062c594 on hv-cinder-77703 May 16 20:42:26.419204 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-b0870d34-55ce-4f9f-8cb3-1c164cea645d req-dffae37b-ee7c-450a-a421-250a1862d574 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037029 May 16 20:42:26.420396 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 316/634] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:42:26.504068 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-c5aa9c03-38ee-4a5c-b111-d1504628f94e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:26.504708 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-c5aa9c03-38ee-4a5c-b111-d1504628f94e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:26.511166 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c5aa9c03-38ee-4a5c-b111-d1504628f94e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:26.511998 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c5aa9c03-38ee-4a5c-b111-d1504628f94e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:26.512807 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c5aa9c03-38ee-4a5c-b111-d1504628f94e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:26.513430 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c5aa9c03-38ee-4a5c-b111-d1504628f94e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:26.543307 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-c5aa9c03-38ee-4a5c-b111-d1504628f94e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Going to try to terminate instance {{(pid=123564) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:42:26.626823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-c5aa9c03-38ee-4a5c-b111-d1504628f94e tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "DELETE /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 204 len: 0 microversion: 2.1 time: 0.126322 May 16 20:42:26.627657 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 319/635] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:42:26 2022] DELETE /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 20:42:26.637024 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-5be1e221-cf4c-4ba3-b5e3-10819c565f46 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:26.637978 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-5be1e221-cf4c-4ba3-b5e3-10819c565f46 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:26.646066 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5be1e221-cf4c-4ba3-b5e3-10819c565f46 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:26.646512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5be1e221-cf4c-4ba3-b5e3-10819c565f46 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:26.647297 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5be1e221-cf4c-4ba3-b5e3-10819c565f46 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:26.647731 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5be1e221-cf4c-4ba3-b5e3-10819c565f46 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:26.791249 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-5be1e221-cf4c-4ba3-b5e3-10819c565f46 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:26.799114 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-5be1e221-cf4c-4ba3-b5e3-10819c565f46 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1508 microversion: 2.1 time: 0.166396 May 16 20:42:26.799681 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 317/636] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:26 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:27.171250 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-9f37491f-fc92-432e-9da7-a515851a50f7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:27.172689 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-9f37491f-fc92-432e-9da7-a515851a50f7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:27.181630 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9f37491f-fc92-432e-9da7-a515851a50f7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:27.182179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9f37491f-fc92-432e-9da7-a515851a50f7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:27.183160 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9f37491f-fc92-432e-9da7-a515851a50f7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:27.183842 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9f37491f-fc92-432e-9da7-a515851a50f7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:27.335588 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-9f37491f-fc92-432e-9da7-a515851a50f7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:27.345821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-9f37491f-fc92-432e-9da7-a515851a50f7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:27.347324 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-9f37491f-fc92-432e-9da7-a515851a50f7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:27.348547 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-9f37491f-fc92-432e-9da7-a515851a50f7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1739 microversion: 2.20 time: 0.183507 May 16 20:42:27.349307 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 320/637] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:27 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:27.817365 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-60b3e908-6d8b-4a12-b804-515e593d801a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:27.818023 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-60b3e908-6d8b-4a12-b804-515e593d801a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:27.825229 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-60b3e908-6d8b-4a12-b804-515e593d801a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:27.825689 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-60b3e908-6d8b-4a12-b804-515e593d801a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:27.826524 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-60b3e908-6d8b-4a12-b804-515e593d801a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:27.826968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-60b3e908-6d8b-4a12-b804-515e593d801a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:27.974156 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-60b3e908-6d8b-4a12-b804-515e593d801a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:27.982008 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-60b3e908-6d8b-4a12-b804-515e593d801a tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1508 microversion: 2.1 time: 0.168754 May 16 20:42:27.982759 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 318/638] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:27 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:28.367930 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-c01567eb-5e88-4c46-9c0b-cff2164afc3f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:28.368597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-c01567eb-5e88-4c46-9c0b-cff2164afc3f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:28.375023 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c01567eb-5e88-4c46-9c0b-cff2164afc3f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:28.375780 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c01567eb-5e88-4c46-9c0b-cff2164afc3f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:28.376254 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c01567eb-5e88-4c46-9c0b-cff2164afc3f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:28.376965 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c01567eb-5e88-4c46-9c0b-cff2164afc3f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:28.527025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-c01567eb-5e88-4c46-9c0b-cff2164afc3f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:28.535811 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-c01567eb-5e88-4c46-9c0b-cff2164afc3f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:28.537326 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-c01567eb-5e88-4c46-9c0b-cff2164afc3f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:28.538497 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-c01567eb-5e88-4c46-9c0b-cff2164afc3f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1739 microversion: 2.20 time: 0.174645 May 16 20:42:28.539879 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 321/639] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:28 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:29.001229 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-59dcc65a-c732-4302-8e9f-8efa032b6a34 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:29.002693 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-59dcc65a-c732-4302-8e9f-8efa032b6a34 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:29.011624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-59dcc65a-c732-4302-8e9f-8efa032b6a34 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:29.012684 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-59dcc65a-c732-4302-8e9f-8efa032b6a34 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:29.013946 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-59dcc65a-c732-4302-8e9f-8efa032b6a34 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:29.014621 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-59dcc65a-c732-4302-8e9f-8efa032b6a34 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:29.191615 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-59dcc65a-c732-4302-8e9f-8efa032b6a34 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:29.202993 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-59dcc65a-c732-4302-8e9f-8efa032b6a34 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 200 len: 1508 microversion: 2.1 time: 0.205022 May 16 20:42:29.204458 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 319/640] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:28 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 1508 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:29.478411 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-ce55b4de-07ec-451b-8daf-2035cc721c22 req-c797ab0e-96d1-4dfd-9ca7-288af8501bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "547bc788-bd6c-4d26-b0aa-abecbd4615fc", "name": "network-vif-deleted", "tag": "664c3d5e-8f87-4842-ba25-1e2046af5e41"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:42:29.491665 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-ce55b4de-07ec-451b-8daf-2035cc721c22 req-c797ab0e-96d1-4dfd-9ca7-288af8501bec service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:29.500516 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-ce55b4de-07ec-451b-8daf-2035cc721c22 req-c797ab0e-96d1-4dfd-9ca7-288af8501bec service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:29.521646 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-ce55b4de-07ec-451b-8daf-2035cc721c22 req-c797ab0e-96d1-4dfd-9ca7-288af8501bec service nova] Creating event network-vif-deleted:664c3d5e-8f87-4842-ba25-1e2046af5e41 for instance 547bc788-bd6c-4d26-b0aa-abecbd4615fc on hv-cinder-77703 May 16 20:42:29.530240 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-ce55b4de-07ec-451b-8daf-2035cc721c22 req-c797ab0e-96d1-4dfd-9ca7-288af8501bec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056115 May 16 20:42:29.540314 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 322/641] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:42:29.557751 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-bebef2e0-a822-4efd-a0f3-c06cfb96fae2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:29.558681 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-bebef2e0-a822-4efd-a0f3-c06cfb96fae2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:29.573533 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-bebef2e0-a822-4efd-a0f3-c06cfb96fae2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:29.574319 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-bebef2e0-a822-4efd-a0f3-c06cfb96fae2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:29.575417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-bebef2e0-a822-4efd-a0f3-c06cfb96fae2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:29.576065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-bebef2e0-a822-4efd-a0f3-c06cfb96fae2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:29.732340 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-bebef2e0-a822-4efd-a0f3-c06cfb96fae2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:29.743023 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-bebef2e0-a822-4efd-a0f3-c06cfb96fae2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:29.744713 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-bebef2e0-a822-4efd-a0f3-c06cfb96fae2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:29.745928 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-bebef2e0-a822-4efd-a0f3-c06cfb96fae2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1739 microversion: 2.20 time: 0.192587 May 16 20:42:29.746807 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 320/642] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:29 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:30.221231 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-0bd9ae02-af2a-419d-baa4-4140acbcb8e5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:30.222461 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-0bd9ae02-af2a-419d-baa4-4140acbcb8e5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: 547bc788-bd6c-4d26-b0aa-abecbd4615fc] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:30.229266 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0bd9ae02-af2a-419d-baa4-4140acbcb8e5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:30.229974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0bd9ae02-af2a-419d-baa4-4140acbcb8e5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:30.230989 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0bd9ae02-af2a-419d-baa4-4140acbcb8e5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:30.231425 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0bd9ae02-af2a-419d-baa4-4140acbcb8e5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:30.246599 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-0bd9ae02-af2a-419d-baa4-4140acbcb8e5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] HTTP exception thrown: Instance 547bc788-bd6c-4d26-b0aa-abecbd4615fc could not be found. May 16 20:42:30.248876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-0bd9ae02-af2a-419d-baa4-4140acbcb8e5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Request method failure captured: May 16 20:42:30.248876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc HTTP/1.1 May 16 20:42:30.248876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:42:30.248876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:42:30.248876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:42:30.248876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:42:30.248876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:42:30.248876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:42:30.248876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:42:30.248876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:42:30.248876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrYz-yjVKwgSFfN0eLNagUyRjDkS79jG85WNDPi_wT024qE-ANQLmJ-KHEJ6Vnv8ngmMt0zEUKEE8CtESkh62DxmHenCL5YAhZjLMoCaFCWuXPk0rDXBZ7EBJ6W3SjHCtjbuNDPg0vhkDGdSnh6SHKwG6VwkTaeY6mnwE6Exhy0aLX0 May 16 20:42:30.248876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:42:30.248876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:42:30.248876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:42:30.248876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:42:30.248876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:42:30.248876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:42:30.248876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 69e39fae43c341798f00e3b48f20d003 May 16 20:42:30.248876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1585639724 May 16 20:42:30.248876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:42:30.248876 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:42:30.250377 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_69e39fae43c341798f00e3b48f20d003"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e39fae43c341798f00e3b48f20d003"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/69e39fae43c341798f00e3b48f20d003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e39fae43c341798f00e3b48f20d003"}]}] May 16 20:42:30.250377 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1585639724 May 16 20:42:30.250377 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 69e39fae43c341798f00e3b48f20d003 May 16 20:42:30.250377 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1585639724 May 16 20:42:30.250377 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-ServerRescueNegativeTestJSON-1585639724-project May 16 20:42:30.250377 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:42:30.250377 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:42:30.250377 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: 20c57f1318cd4c73b2248b2d02896176 May 16 20:42:30.250377 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1585639724-project May 16 20:42:30.250377 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:42:30.250377 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance 547bc788-bd6c-4d26-b0aa-abecbd4615fc could not be found. May 16 20:42:30.250377 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': '547bc788-bd6c-4d26-b0aa-abecbd4615fc'} May 16 20:42:30.251215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:42:30.251215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:42:30.251215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:42:30.251215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:42:30.251215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:42:30.251215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:42:30.251215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:42:30.251215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:42:30.251215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:42:30.251215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:42:30.251215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 547bc788-bd6c-4d26-b0aa-abecbd4615fc could not be found. May 16 20:42:30.251215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:30.251215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:42:30.251215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:30.251215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:42:30.251215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:42:30.251215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:42:30.251215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:42:30.251215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:42:30.251215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:42:30.252597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:42:30.252597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:42:30.252597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:42:30.252597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:42:30.252597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:42:30.252597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:42:30.252597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:42:30.252597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 547bc788-bd6c-4d26-b0aa-abecbd4615fc could not be found. May 16 20:42:30.252597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:30.252597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:42:30.252597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:30.252597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:42:30.252597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:42:30.252597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:42:30.252597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:42:30.252597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:42:30.252597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 547bc788-bd6c-4d26-b0aa-abecbd4615fc could not be found. May 16 20:42:30.252597 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:30.257131 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-0bd9ae02-af2a-419d-baa4-4140acbcb8e5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Returning 404 to user: Instance 547bc788-bd6c-4d26-b0aa-abecbd4615fc could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:42:30.257131 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-0bd9ae02-af2a-419d-baa4-4140acbcb8e5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc" status: 404 len: 111 microversion: 2.1 time: 0.033764 May 16 20:42:30.257131 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 323/643] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:30 2022] GET /compute/v2.1/servers/547bc788-bd6c-4d26-b0aa-abecbd4615fc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:42:30.265805 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-6b941f2d-473d-4e24-bfa0-4ac2e57f0a57 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:30.266337 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-6b941f2d-473d-4e24-bfa0-4ac2e57f0a57 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:30.275016 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6b941f2d-473d-4e24-bfa0-4ac2e57f0a57 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:30.275515 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6b941f2d-473d-4e24-bfa0-4ac2e57f0a57 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:30.276344 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6b941f2d-473d-4e24-bfa0-4ac2e57f0a57 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:30.277005 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6b941f2d-473d-4e24-bfa0-4ac2e57f0a57 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:30.303214 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-6b941f2d-473d-4e24-bfa0-4ac2e57f0a57 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Going to try to terminate instance {{(pid=123563) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:42:30.395056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-6b941f2d-473d-4e24-bfa0-4ac2e57f0a57 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 204 len: 0 microversion: 2.1 time: 0.139634 May 16 20:42:30.396181 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 321/644] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:42:30 2022] DELETE /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 20:42:30.405241 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e8689d5a-7430-461c-a2b3-b33a3ea27b1c tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:30.406113 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-e8689d5a-7430-461c-a2b3-b33a3ea27b1c tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:30.412697 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e8689d5a-7430-461c-a2b3-b33a3ea27b1c tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:30.413150 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e8689d5a-7430-461c-a2b3-b33a3ea27b1c tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:30.413952 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e8689d5a-7430-461c-a2b3-b33a3ea27b1c tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:30.414387 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e8689d5a-7430-461c-a2b3-b33a3ea27b1c tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:30.596014 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e8689d5a-7430-461c-a2b3-b33a3ea27b1c tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:30.603611 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-e8689d5a-7430-461c-a2b3-b33a3ea27b1c tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1521 microversion: 2.1 time: 0.202873 May 16 20:42:30.604167 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 324/645] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:30 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:42:30.763875 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-32cb39d3-4e59-48d4-a77e-b5d6587abc62 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:30.764688 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-32cb39d3-4e59-48d4-a77e-b5d6587abc62 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:30.771272 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-32cb39d3-4e59-48d4-a77e-b5d6587abc62 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:30.771799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-32cb39d3-4e59-48d4-a77e-b5d6587abc62 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:30.772710 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-32cb39d3-4e59-48d4-a77e-b5d6587abc62 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:30.773220 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-32cb39d3-4e59-48d4-a77e-b5d6587abc62 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:30.910565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-32cb39d3-4e59-48d4-a77e-b5d6587abc62 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:30.920127 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-32cb39d3-4e59-48d4-a77e-b5d6587abc62 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:30.921799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-32cb39d3-4e59-48d4-a77e-b5d6587abc62 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:30.923103 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-32cb39d3-4e59-48d4-a77e-b5d6587abc62 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1739 microversion: 2.20 time: 0.163645 May 16 20:42:30.923948 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 322/646] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:30 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:31.624906 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-f526649d-88ca-4660-85be-940c7fed76e5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:31.630920 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-4d0bf775-9260-408a-a20d-37875dbbf0d8 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:31.631428 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-4d0bf775-9260-408a-a20d-37875dbbf0d8 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:31.639962 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-f526649d-88ca-4660-85be-940c7fed76e5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:31.649684 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4d0bf775-9260-408a-a20d-37875dbbf0d8 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:31.650109 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4d0bf775-9260-408a-a20d-37875dbbf0d8 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:31.650894 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4d0bf775-9260-408a-a20d-37875dbbf0d8 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:31.651363 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4d0bf775-9260-408a-a20d-37875dbbf0d8 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:31.659550 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f526649d-88ca-4660-85be-940c7fed76e5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:31.660737 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f526649d-88ca-4660-85be-940c7fed76e5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:31.661572 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f526649d-88ca-4660-85be-940c7fed76e5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:31.662184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f526649d-88ca-4660-85be-940c7fed76e5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:31.694569 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-4d0bf775-9260-408a-a20d-37875dbbf0d8 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Going to try to terminate instance {{(pid=123563) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:42:31.803523 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-4d0bf775-9260-408a-a20d-37875dbbf0d8 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 204 len: 0 microversion: 2.1 time: 0.176128 May 16 20:42:31.804474 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 323/647] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:42:31 2022] DELETE /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 20:42:31.816751 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-47971967-f98f-497b-8e28-fb70502faa1b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:31.818107 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-47971967-f98f-497b-8e28-fb70502faa1b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:31.825761 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-47971967-f98f-497b-8e28-fb70502faa1b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:31.827102 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-47971967-f98f-497b-8e28-fb70502faa1b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:31.827992 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-47971967-f98f-497b-8e28-fb70502faa1b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:31.828997 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-47971967-f98f-497b-8e28-fb70502faa1b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:31.836275 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-f526649d-88ca-4660-85be-940c7fed76e5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:31.846741 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-f526649d-88ca-4660-85be-940c7fed76e5 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1521 microversion: 2.1 time: 0.227573 May 16 20:42:31.847579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 325/648] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:31 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:31.941431 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-070f3e64-1e88-4eaf-9204-2a82883d6b9a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:31.942307 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-070f3e64-1e88-4eaf-9204-2a82883d6b9a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:31.953412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-070f3e64-1e88-4eaf-9204-2a82883d6b9a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:31.955759 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-070f3e64-1e88-4eaf-9204-2a82883d6b9a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:31.957321 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-070f3e64-1e88-4eaf-9204-2a82883d6b9a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:31.959157 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-070f3e64-1e88-4eaf-9204-2a82883d6b9a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:31.990653 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-47971967-f98f-497b-8e28-fb70502faa1b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:31.998901 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-47971967-f98f-497b-8e28-fb70502faa1b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1579 microversion: 2.1 time: 0.188290 May 16 20:42:32.008502 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 324/649] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:31 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1579 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:32.114627 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-070f3e64-1e88-4eaf-9204-2a82883d6b9a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:32.125303 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-070f3e64-1e88-4eaf-9204-2a82883d6b9a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:32.127584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-070f3e64-1e88-4eaf-9204-2a82883d6b9a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:32.128871 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-070f3e64-1e88-4eaf-9204-2a82883d6b9a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1739 microversion: 2.20 time: 0.191246 May 16 20:42:32.129915 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 326/650] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:31 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:32.866871 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-f7d56626-6002-40ea-842c-b512f64a5374 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:32.867463 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-f7d56626-6002-40ea-842c-b512f64a5374 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:32.874891 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f7d56626-6002-40ea-842c-b512f64a5374 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:32.875539 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f7d56626-6002-40ea-842c-b512f64a5374 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:32.876323 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f7d56626-6002-40ea-842c-b512f64a5374 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:32.876764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f7d56626-6002-40ea-842c-b512f64a5374 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:33.018042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-86f8fd59-1c68-4a8d-af27-154ffbb265a2 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:33.018670 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-86f8fd59-1c68-4a8d-af27-154ffbb265a2 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:33.022937 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f7d56626-6002-40ea-842c-b512f64a5374 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:33.026386 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-86f8fd59-1c68-4a8d-af27-154ffbb265a2 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:33.027087 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-86f8fd59-1c68-4a8d-af27-154ffbb265a2 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:33.027892 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-86f8fd59-1c68-4a8d-af27-154ffbb265a2 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:33.028335 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-86f8fd59-1c68-4a8d-af27-154ffbb265a2 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:33.031818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-f7d56626-6002-40ea-842c-b512f64a5374 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1521 microversion: 2.1 time: 0.171177 May 16 20:42:33.041269 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 325/651] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:32 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:33.147264 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-ff4e1720-48a4-4a5b-824c-abc21ed73017 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:33.148238 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-ff4e1720-48a4-4a5b-824c-abc21ed73017 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:33.154728 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ff4e1720-48a4-4a5b-824c-abc21ed73017 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:33.155478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ff4e1720-48a4-4a5b-824c-abc21ed73017 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:33.156275 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ff4e1720-48a4-4a5b-824c-abc21ed73017 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:33.156823 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ff4e1720-48a4-4a5b-824c-abc21ed73017 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:33.168312 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-86f8fd59-1c68-4a8d-af27-154ffbb265a2 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:33.175940 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-86f8fd59-1c68-4a8d-af27-154ffbb265a2 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1579 microversion: 2.1 time: 0.162605 May 16 20:42:33.188854 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 327/652] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:33 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1579 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:33.313638 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ff4e1720-48a4-4a5b-824c-abc21ed73017 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:33.324487 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ff4e1720-48a4-4a5b-824c-abc21ed73017 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:33.325938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ff4e1720-48a4-4a5b-824c-abc21ed73017 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:33.327209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-ff4e1720-48a4-4a5b-824c-abc21ed73017 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1739 microversion: 2.20 time: 0.183964 May 16 20:42:33.327753 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 326/653] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:33 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:42:34.049054 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-153979bf-c8fb-4d98-b6b5-1e79bfd77154 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:34.049675 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-153979bf-c8fb-4d98-b6b5-1e79bfd77154 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:34.056715 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-153979bf-c8fb-4d98-b6b5-1e79bfd77154 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:34.057167 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-153979bf-c8fb-4d98-b6b5-1e79bfd77154 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:34.057937 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-153979bf-c8fb-4d98-b6b5-1e79bfd77154 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:34.058374 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-153979bf-c8fb-4d98-b6b5-1e79bfd77154 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:34.195609 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-952d4b5e-8d6a-47f6-9be7-34c5eedfa5c1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:34.196155 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-952d4b5e-8d6a-47f6-9be7-34c5eedfa5c1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:34.200497 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-153979bf-c8fb-4d98-b6b5-1e79bfd77154 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:34.203378 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-952d4b5e-8d6a-47f6-9be7-34c5eedfa5c1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:34.203833 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-952d4b5e-8d6a-47f6-9be7-34c5eedfa5c1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:34.204671 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-952d4b5e-8d6a-47f6-9be7-34c5eedfa5c1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:34.205109 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-952d4b5e-8d6a-47f6-9be7-34c5eedfa5c1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:34.208360 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-153979bf-c8fb-4d98-b6b5-1e79bfd77154 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1521 microversion: 2.1 time: 0.163265 May 16 20:42:34.208962 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 328/654] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:34 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:34.334680 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-952d4b5e-8d6a-47f6-9be7-34c5eedfa5c1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:34.342859 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-952d4b5e-8d6a-47f6-9be7-34c5eedfa5c1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1579 microversion: 2.1 time: 0.153355 May 16 20:42:34.343439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 327/655] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:34 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:34.345293 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-4398166f-66ba-4c0b-8fdb-7f61232ea9f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:34.345900 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-4398166f-66ba-4c0b-8fdb-7f61232ea9f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:34.351813 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4398166f-66ba-4c0b-8fdb-7f61232ea9f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:34.352269 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4398166f-66ba-4c0b-8fdb-7f61232ea9f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:34.353058 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4398166f-66ba-4c0b-8fdb-7f61232ea9f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:34.353483 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4398166f-66ba-4c0b-8fdb-7f61232ea9f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:34.490902 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-4398166f-66ba-4c0b-8fdb-7f61232ea9f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:34.499192 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-4398166f-66ba-4c0b-8fdb-7f61232ea9f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:34.500809 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-4398166f-66ba-4c0b-8fdb-7f61232ea9f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:34.502038 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-4398166f-66ba-4c0b-8fdb-7f61232ea9f2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1739 microversion: 2.20 time: 0.160706 May 16 20:42:34.502635 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 329/656] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:34 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:42:34.630826 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-5c423b77-f5f1-44d1-ad60-19cf3ace6cff tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:34.631328 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-5c423b77-f5f1-44d1-ad60-19cf3ace6cff tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:34.637479 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5c423b77-f5f1-44d1-ad60-19cf3ace6cff tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:34.637934 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5c423b77-f5f1-44d1-ad60-19cf3ace6cff tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:34.638707 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5c423b77-f5f1-44d1-ad60-19cf3ace6cff tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:34.639150 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5c423b77-f5f1-44d1-ad60-19cf3ace6cff tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:34.662256 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-5c423b77-f5f1-44d1-ad60-19cf3ace6cff tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833/ips" status: 200 len: 151 microversion: 2.1 time: 0.207227 May 16 20:42:34.662821 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 328/657] 10.222.0.49 () {58 vars in 1247 bytes} [Mon May 16 20:42:34 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833/ips => generated 151 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:42:35.231631 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-80b53abb-8827-4f61-8c7c-53a7e8766da8 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:35.232802 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-80b53abb-8827-4f61-8c7c-53a7e8766da8 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:35.243648 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-80b53abb-8827-4f61-8c7c-53a7e8766da8 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:35.244388 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-80b53abb-8827-4f61-8c7c-53a7e8766da8 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:35.246891 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-80b53abb-8827-4f61-8c7c-53a7e8766da8 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:35.247695 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-80b53abb-8827-4f61-8c7c-53a7e8766da8 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:35.362518 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-b5ab4936-4e0b-45ec-a53d-422753322acc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:35.363770 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-b5ab4936-4e0b-45ec-a53d-422753322acc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:35.374382 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b5ab4936-4e0b-45ec-a53d-422753322acc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:35.374583 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b5ab4936-4e0b-45ec-a53d-422753322acc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:35.375639 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b5ab4936-4e0b-45ec-a53d-422753322acc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:35.378536 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b5ab4936-4e0b-45ec-a53d-422753322acc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:35.560202 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-80b53abb-8827-4f61-8c7c-53a7e8766da8 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c57f1318cd4c73b2248b2d02896176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e39fae43c341798f00e3b48f20d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:35.569897 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-80b53abb-8827-4f61-8c7c-53a7e8766da8 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 200 len: 1521 microversion: 2.1 time: 0.346817 May 16 20:42:35.579804 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 330/658] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:35 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 1521 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:35.580146 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-3a4542cf-d7a6-4b44-86a5-5c1290e4ee63 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:35.580846 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-3a4542cf-d7a6-4b44-86a5-5c1290e4ee63 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:35.587272 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3a4542cf-d7a6-4b44-86a5-5c1290e4ee63 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:35.588057 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3a4542cf-d7a6-4b44-86a5-5c1290e4ee63 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:35.588967 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3a4542cf-d7a6-4b44-86a5-5c1290e4ee63 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:35.589567 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3a4542cf-d7a6-4b44-86a5-5c1290e4ee63 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:35.856762 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-b5ab4936-4e0b-45ec-a53d-422753322acc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:35.865139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-b5ab4936-4e0b-45ec-a53d-422753322acc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1579 microversion: 2.1 time: 0.508041 May 16 20:42:35.865904 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 329/659] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:35 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1579 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:35.870121 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-abedac89-6a3c-411b-83f2-28693cc97359 req-32b8c919-3fb4-4f9c-8e70-5279f335bfce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02eea51-3d7f-45e0-83ee-349ebd8121f8", "name": "network-vif-deleted", "tag": "635fb22a-138e-46f9-9e24-14a4fd81ffc2"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:42:35.878188 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-abedac89-6a3c-411b-83f2-28693cc97359 req-32b8c919-3fb4-4f9c-8e70-5279f335bfce service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:35.878614 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-abedac89-6a3c-411b-83f2-28693cc97359 req-32b8c919-3fb4-4f9c-8e70-5279f335bfce service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:35.890849 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-abedac89-6a3c-411b-83f2-28693cc97359 req-32b8c919-3fb4-4f9c-8e70-5279f335bfce service nova] Creating event network-vif-deleted:635fb22a-138e-46f9-9e24-14a4fd81ffc2 for instance d02eea51-3d7f-45e0-83ee-349ebd8121f8 on hv-cinder-77703 May 16 20:42:35.895889 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-abedac89-6a3c-411b-83f2-28693cc97359 req-32b8c919-3fb4-4f9c-8e70-5279f335bfce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029044 May 16 20:42:35.896700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 330/660] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:42:35.951896 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3a4542cf-d7a6-4b44-86a5-5c1290e4ee63 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:35.960243 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3a4542cf-d7a6-4b44-86a5-5c1290e4ee63 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:35.961767 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3a4542cf-d7a6-4b44-86a5-5c1290e4ee63 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:35.962947 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-3a4542cf-d7a6-4b44-86a5-5c1290e4ee63 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1721 microversion: 2.20 time: 0.387577 May 16 20:42:35.963740 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 331/661] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:35 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1721 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:35.990509 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-84018ee6-3622-42f6-8a06-c7b4c9a98634 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "134551cb-f19d-4b77-a4a7-0510ce5cfdca"}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:42:35.991757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-84018ee6-3622-42f6-8a06-c7b4c9a98634 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:35.998420 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-84018ee6-3622-42f6-8a06-c7b4c9a98634 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:35.998860 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-84018ee6-3622-42f6-8a06-c7b4c9a98634 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:35.999850 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-84018ee6-3622-42f6-8a06-c7b4c9a98634 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:36.000375 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-84018ee6-3622-42f6-8a06-c7b4c9a98634 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:36.280291 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-84018ee6-3622-42f6-8a06-c7b4c9a98634 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "POST /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294458 May 16 20:42:36.280937 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 331/662] 10.222.0.49 () {60 vars in 1322 bytes} [Mon May 16 20:42:35 2022] POST /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:42:36.587615 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-ada0d110-ce4c-491b-82c5-52a7fd965973 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:36.588184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-ada0d110-ce4c-491b-82c5-52a7fd965973 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] [instance: d02eea51-3d7f-45e0-83ee-349ebd8121f8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:36.595199 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ada0d110-ce4c-491b-82c5-52a7fd965973 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:36.595645 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ada0d110-ce4c-491b-82c5-52a7fd965973 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:36.596426 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ada0d110-ce4c-491b-82c5-52a7fd965973 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:36.596886 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ada0d110-ce4c-491b-82c5-52a7fd965973 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:36.611647 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-ada0d110-ce4c-491b-82c5-52a7fd965973 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] HTTP exception thrown: Instance d02eea51-3d7f-45e0-83ee-349ebd8121f8 could not be found. May 16 20:42:36.613284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-ada0d110-ce4c-491b-82c5-52a7fd965973 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Request method failure captured: May 16 20:42:36.613284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 HTTP/1.1 May 16 20:42:36.613284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:42:36.613284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:42:36.613284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:42:36.613284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:42:36.613284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:42:36.613284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:42:36.613284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:42:36.613284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:42:36.613284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrYz-yjVKwgSFfN0eLNagUyRjDkS79jG85WNDPi_wT024qE-ANQLmJ-KHEJ6Vnv8ngmMt0zEUKEE8CtESkh62DxmHenCL5YAhZjLMoCaFCWuXPk0rDXBZ7EBJ6W3SjHCtjbuNDPg0vhkDGdSnh6SHKwG6VwkTaeY6mnwE6Exhy0aLX0 May 16 20:42:36.613284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:42:36.613284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:42:36.613284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:42:36.613284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:42:36.613284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:42:36.613284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:42:36.613284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 69e39fae43c341798f00e3b48f20d003 May 16 20:42:36.613284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1585639724 May 16 20:42:36.613284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:42:36.613284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:42:36.614901 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_69e39fae43c341798f00e3b48f20d003"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e39fae43c341798f00e3b48f20d003"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/69e39fae43c341798f00e3b48f20d003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e39fae43c341798f00e3b48f20d003"}]}] May 16 20:42:36.614901 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1585639724 May 16 20:42:36.614901 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 69e39fae43c341798f00e3b48f20d003 May 16 20:42:36.614901 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1585639724 May 16 20:42:36.614901 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-ServerRescueNegativeTestJSON-1585639724-project May 16 20:42:36.614901 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:42:36.614901 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:42:36.614901 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: 20c57f1318cd4c73b2248b2d02896176 May 16 20:42:36.614901 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1585639724-project May 16 20:42:36.614901 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:42:36.614901 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance d02eea51-3d7f-45e0-83ee-349ebd8121f8 could not be found. May 16 20:42:36.614901 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': 'd02eea51-3d7f-45e0-83ee-349ebd8121f8'} May 16 20:42:36.615681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:42:36.615681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:42:36.615681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:42:36.615681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:42:36.615681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:42:36.615681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:42:36.615681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:42:36.615681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:42:36.615681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:42:36.615681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:42:36.615681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02eea51-3d7f-45e0-83ee-349ebd8121f8 could not be found. May 16 20:42:36.615681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:36.615681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:42:36.615681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:36.615681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:42:36.615681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:42:36.615681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:42:36.615681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:42:36.615681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:42:36.615681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:42:36.617065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:42:36.617065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:42:36.617065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:42:36.617065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:42:36.617065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:42:36.617065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:42:36.617065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:42:36.617065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02eea51-3d7f-45e0-83ee-349ebd8121f8 could not be found. May 16 20:42:36.617065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:36.617065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:42:36.617065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:36.617065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:42:36.617065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:42:36.617065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:42:36.617065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:42:36.617065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:42:36.617065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02eea51-3d7f-45e0-83ee-349ebd8121f8 could not be found. May 16 20:42:36.617065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:36.618141 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-ada0d110-ce4c-491b-82c5-52a7fd965973 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] Returning 404 to user: Instance d02eea51-3d7f-45e0-83ee-349ebd8121f8 could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:42:36.618141 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-ada0d110-ce4c-491b-82c5-52a7fd965973 tempest-ServerRescueNegativeTestJSON-1585639724 tempest-ServerRescueNegativeTestJSON-1585639724-project] 10.222.0.49 "GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8" status: 404 len: 111 microversion: 2.1 time: 0.031372 May 16 20:42:36.618141 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 332/663] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:36 2022] GET /compute/v2.1/servers/d02eea51-3d7f-45e0-83ee-349ebd8121f8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:42:36.883201 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-cbd25be2-ce4f-4982-9332-0efb824d71fb tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:36.884791 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-cbd25be2-ce4f-4982-9332-0efb824d71fb tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:36.892812 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cbd25be2-ce4f-4982-9332-0efb824d71fb tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:36.893420 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cbd25be2-ce4f-4982-9332-0efb824d71fb tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:36.894316 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cbd25be2-ce4f-4982-9332-0efb824d71fb tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:36.894960 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-cbd25be2-ce4f-4982-9332-0efb824d71fb tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:36.971979 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-cbd25be2-ce4f-4982-9332-0efb824d71fb tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:36.981787 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a1c72c63-d171-480a-b189-b36ae6d49467 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:36.983312 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-a1c72c63-d171-480a-b189-b36ae6d49467 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:36.991591 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a1c72c63-d171-480a-b189-b36ae6d49467 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:36.992820 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a1c72c63-d171-480a-b189-b36ae6d49467 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:36.993997 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a1c72c63-d171-480a-b189-b36ae6d49467 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:36.994596 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a1c72c63-d171-480a-b189-b36ae6d49467 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:36.995904 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-cbd25be2-ce4f-4982-9332-0efb824d71fb tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1511 microversion: 2.1 time: 0.115791 May 16 20:42:37.005477 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 332/664] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:36 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1511 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:37.152000 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-756eb885-facc-45df-bce2-04e69c99da45 req-b32115e3-fba9-4d8b-ad60-3acbdf2f3c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d149cb81-d021-4785-8e2b-8fb70edb0abb", "name": "network-vif-deleted", "tag": "31d1ca32-03e8-4112-856f-1d72165236d2"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:42:37.161983 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-756eb885-facc-45df-bce2-04e69c99da45 req-b32115e3-fba9-4d8b-ad60-3acbdf2f3c45 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:37.162742 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-756eb885-facc-45df-bce2-04e69c99da45 req-b32115e3-fba9-4d8b-ad60-3acbdf2f3c45 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:37.173812 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a1c72c63-d171-480a-b189-b36ae6d49467 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:37.182917 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a1c72c63-d171-480a-b189-b36ae6d49467 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:37.184399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a1c72c63-d171-480a-b189-b36ae6d49467 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:37.185655 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-a1c72c63-d171-480a-b189-b36ae6d49467 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1721 microversion: 2.20 time: 0.208122 May 16 20:42:37.186606 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 333/665] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:36 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:42:37.195152 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-756eb885-facc-45df-bce2-04e69c99da45 req-b32115e3-fba9-4d8b-ad60-3acbdf2f3c45 service nova] Creating event network-vif-deleted:31d1ca32-03e8-4112-856f-1d72165236d2 for instance d149cb81-d021-4785-8e2b-8fb70edb0abb on hv-cinder-77703 May 16 20:42:37.201867 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-756eb885-facc-45df-bce2-04e69c99da45 req-b32115e3-fba9-4d8b-ad60-3acbdf2f3c45 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116785 May 16 20:42:37.203165 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 333/666] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:42:38.015132 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-c91fd375-8aaf-4924-8160-ca1d05f2eaec tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:38.015716 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-c91fd375-8aaf-4924-8160-ca1d05f2eaec tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:38.025285 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c91fd375-8aaf-4924-8160-ca1d05f2eaec tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:38.025823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c91fd375-8aaf-4924-8160-ca1d05f2eaec tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:38.027236 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c91fd375-8aaf-4924-8160-ca1d05f2eaec tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:38.027700 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c91fd375-8aaf-4924-8160-ca1d05f2eaec tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:38.091029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-c91fd375-8aaf-4924-8160-ca1d05f2eaec tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:38.098600 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-c91fd375-8aaf-4924-8160-ca1d05f2eaec tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1511 microversion: 2.1 time: 0.089155 May 16 20:42:38.099162 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 334/667] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:38 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1511 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:42:38.204861 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-a3230897-9e36-41e1-9cbf-17778b32e344 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:38.206161 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-a3230897-9e36-41e1-9cbf-17778b32e344 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:38.212901 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a3230897-9e36-41e1-9cbf-17778b32e344 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:38.213691 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a3230897-9e36-41e1-9cbf-17778b32e344 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:38.214525 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a3230897-9e36-41e1-9cbf-17778b32e344 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:38.215040 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a3230897-9e36-41e1-9cbf-17778b32e344 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:38.458362 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a3230897-9e36-41e1-9cbf-17778b32e344 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:38.466283 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a3230897-9e36-41e1-9cbf-17778b32e344 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:38.467803 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a3230897-9e36-41e1-9cbf-17778b32e344 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:38.469006 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-a3230897-9e36-41e1-9cbf-17778b32e344 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1721 microversion: 2.20 time: 0.269425 May 16 20:42:38.469570 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 334/668] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:38 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1721 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:39.118843 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-3aab251c-7423-4a87-9c72-1c9e0f21b1d7 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:39.119469 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-3aab251c-7423-4a87-9c72-1c9e0f21b1d7 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:39.127701 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3aab251c-7423-4a87-9c72-1c9e0f21b1d7 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:39.128369 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3aab251c-7423-4a87-9c72-1c9e0f21b1d7 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:39.129677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3aab251c-7423-4a87-9c72-1c9e0f21b1d7 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:39.130493 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3aab251c-7423-4a87-9c72-1c9e0f21b1d7 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:39.178094 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3aab251c-7423-4a87-9c72-1c9e0f21b1d7 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:39.179012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3aab251c-7423-4a87-9c72-1c9e0f21b1d7 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:39.180564 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.objects.instance [None req-3aab251c-7423-4a87-9c72-1c9e0f21b1d7 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lazy-loading 'fault' on Instance uuid d149cb81-d021-4785-8e2b-8fb70edb0abb {{(pid=123564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:42:39.271010 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3aab251c-7423-4a87-9c72-1c9e0f21b1d7 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:39.277703 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-3aab251c-7423-4a87-9c72-1c9e0f21b1d7 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 200 len: 1184 microversion: 2.1 time: 0.164480 May 16 20:42:39.278273 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 335/669] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:39 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 1184 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:39.487455 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-ba48b8ce-52c7-449e-af80-2680532a7609 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:39.488669 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-ba48b8ce-52c7-449e-af80-2680532a7609 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:39.495419 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ba48b8ce-52c7-449e-af80-2680532a7609 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:39.495927 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ba48b8ce-52c7-449e-af80-2680532a7609 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:39.496869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ba48b8ce-52c7-449e-af80-2680532a7609 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:39.497508 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ba48b8ce-52c7-449e-af80-2680532a7609 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:39.733865 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ba48b8ce-52c7-449e-af80-2680532a7609 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:39.744491 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ba48b8ce-52c7-449e-af80-2680532a7609 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:39.746330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ba48b8ce-52c7-449e-af80-2680532a7609 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:39.747865 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-ba48b8ce-52c7-449e-af80-2680532a7609 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1664 microversion: 2.20 time: 0.264461 May 16 20:42:39.748718 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 335/670] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:39 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1664 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:39.783031 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-4611a16a-8afb-4ee1-9904-8381b1c56191 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1c14492-01c6-4bf2-b488-ddf4f8a86bc7"}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:42:39.788722 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-4611a16a-8afb-4ee1-9904-8381b1c56191 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:39.795680 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4611a16a-8afb-4ee1-9904-8381b1c56191 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:39.796130 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4611a16a-8afb-4ee1-9904-8381b1c56191 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:39.797051 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4611a16a-8afb-4ee1-9904-8381b1c56191 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:39.798915 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4611a16a-8afb-4ee1-9904-8381b1c56191 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:40.127506 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-4611a16a-8afb-4ee1-9904-8381b1c56191 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "POST /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.360976 May 16 20:42:40.128187 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 336/671] 10.222.0.49 () {62 vars in 1363 bytes} [Mon May 16 20:42:39 2022] POST /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594/os-volume_attachments => generated 188 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 20:42:40.241323 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-90b5b064-9e5a-4c0f-9f0c-94ce157c967e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:40.241812 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-90b5b064-9e5a-4c0f-9f0c-94ce157c967e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:40.247870 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-90b5b064-9e5a-4c0f-9f0c-94ce157c967e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:40.248351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-90b5b064-9e5a-4c0f-9f0c-94ce157c967e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:40.249231 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-90b5b064-9e5a-4c0f-9f0c-94ce157c967e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:40.249667 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-90b5b064-9e5a-4c0f-9f0c-94ce157c967e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:40.294714 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-15e71f19-95ac-42dd-87e7-2ed68bbe4858 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:40.295768 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-15e71f19-95ac-42dd-87e7-2ed68bbe4858 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:40.302908 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-15e71f19-95ac-42dd-87e7-2ed68bbe4858 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:40.303438 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-15e71f19-95ac-42dd-87e7-2ed68bbe4858 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:40.304270 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-15e71f19-95ac-42dd-87e7-2ed68bbe4858 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:40.304889 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-15e71f19-95ac-42dd-87e7-2ed68bbe4858 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:40.326550 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-15e71f19-95ac-42dd-87e7-2ed68bbe4858 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] HTTP exception thrown: Instance d149cb81-d021-4785-8e2b-8fb70edb0abb could not be found. May 16 20:42:40.328156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-15e71f19-95ac-42dd-87e7-2ed68bbe4858 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Request method failure captured: May 16 20:42:40.328156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb HTTP/1.1 May 16 20:42:40.328156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:42:40.328156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:42:40.328156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:42:40.328156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:42:40.328156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:42:40.328156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:42:40.328156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:42:40.328156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:42:40.328156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrZ5Vc8NXooCBCmkZo1tt1PldAz_yBfVhqkVEQlj9Qe9yg3qoQ_NmEZiM2PJpp5v3dKhyxQqNUbimeMcM8ilnX6R-suhozFP71ObYN3jw-b4qBQALQLxrghC1T2tYosx42QkJ-eoJbqIfSEDBO0UbmHhsldlNHt5ZpSE3_D4WGGf8xY May 16 20:42:40.328156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:42:40.328156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:42:40.328156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:42:40.328156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:42:40.328156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:42:40.328156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:42:40.328156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 710ecde5160640149c693e0c2b0b0354 May 16 20:42:40.328156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-TestVolumeBootPattern-1176723552 May 16 20:42:40.328156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:42:40.328156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:42:40.329588 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_710ecde5160640149c693e0c2b0b0354"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/710ecde5160640149c693e0c2b0b0354"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/710ecde5160640149c693e0c2b0b0354"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/710ecde5160640149c693e0c2b0b0354"}]}] May 16 20:42:40.329588 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-TestVolumeBootPattern-1176723552 May 16 20:42:40.329588 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 710ecde5160640149c693e0c2b0b0354 May 16 20:42:40.329588 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-TestVolumeBootPattern-1176723552 May 16 20:42:40.329588 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-TestVolumeBootPattern-1176723552-project May 16 20:42:40.329588 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:42:40.329588 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:42:40.329588 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: 6fa431ce09e44b85b61af972bbce2ed4 May 16 20:42:40.329588 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-TestVolumeBootPattern-1176723552-project May 16 20:42:40.329588 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:42:40.329588 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance d149cb81-d021-4785-8e2b-8fb70edb0abb could not be found. May 16 20:42:40.329588 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': 'd149cb81-d021-4785-8e2b-8fb70edb0abb'} May 16 20:42:40.330399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:42:40.330399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:42:40.330399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:42:40.330399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:42:40.330399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:42:40.330399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:42:40.330399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:42:40.330399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:42:40.330399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:42:40.330399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:42:40.330399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d149cb81-d021-4785-8e2b-8fb70edb0abb could not be found. May 16 20:42:40.330399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:40.330399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:42:40.330399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:40.330399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:42:40.330399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:42:40.330399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:42:40.330399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:42:40.330399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:42:40.330399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:42:40.333101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:42:40.333101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:42:40.333101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:42:40.333101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:42:40.333101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:42:40.333101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:42:40.333101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:42:40.333101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d149cb81-d021-4785-8e2b-8fb70edb0abb could not be found. May 16 20:42:40.333101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:40.333101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:42:40.333101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:40.333101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:42:40.333101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:42:40.333101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:42:40.333101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:42:40.333101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:42:40.333101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d149cb81-d021-4785-8e2b-8fb70edb0abb could not be found. May 16 20:42:40.333101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:40.335247 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-15e71f19-95ac-42dd-87e7-2ed68bbe4858 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Returning 404 to user: Instance d149cb81-d021-4785-8e2b-8fb70edb0abb could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:42:40.335247 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-15e71f19-95ac-42dd-87e7-2ed68bbe4858 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 404 len: 111 microversion: 2.1 time: 0.038936 May 16 20:42:40.339433 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 337/672] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:40 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 20:42:40.469338 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-c4ddf712-a223-4239-8eb6-dba55a5e1a42 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-732400685", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1538528591", "security_groups": [{"name": "tempest-secgroup-smoke-2122782084"}], "block_device_mapping_v2": [{"uuid": "ef7250c7-95db-4adb-ae93-697c51aa118f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f4ce36dc-b331-48ab-b5b5-0de5501adc95"}]}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:42:40.541345 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-90b5b064-9e5a-4c0f-9f0c-94ce157c967e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594/os-volume_attachments/d1c14492-01c6-4bf2-b488-ddf4f8a86bc7" status: 202 len: 0 microversion: 2.20 time: 0.303939 May 16 20:42:40.542969 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 336/673] 10.222.0.49 () {60 vars in 1456 bytes} [Mon May 16 20:42:40 2022] DELETE /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594/os-volume_attachments/d1c14492-01c6-4bf2-b488-ddf4f8a86bc7 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 20:42:40.606136 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.network.neutron [None req-c4ddf712-a223-4239-8eb6-dba55a5e1a42 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] validate_networks() for [('f4ce36dc-b331-48ab-b5b5-0de5501adc95', None, None, None, None, None)] {{(pid=123564) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:42:40.764650 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-aeea73a3-2de4-4e44-b4f7-1846048ebbe7 req-910dc9bd-ad1f-4559-b0d5-540e28dec94c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1718fbf6-1460-443d-9fb4-815bf062c594", "name": "network-vif-unplugged", "status": "completed", "tag": "21b40ca4-40ac-4a3f-9958-fe3007671e02"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:42:40.776884 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-aeea73a3-2de4-4e44-b4f7-1846048ebbe7 req-910dc9bd-ad1f-4559-b0d5-540e28dec94c service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:40.777317 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-aeea73a3-2de4-4e44-b4f7-1846048ebbe7 req-910dc9bd-ad1f-4559-b0d5-540e28dec94c service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:40.787640 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.compute.server_external_events [req-aeea73a3-2de4-4e44-b4f7-1846048ebbe7 req-910dc9bd-ad1f-4559-b0d5-540e28dec94c service nova] Unable to find a host for instance 1718fbf6-1460-443d-9fb4-815bf062c594. Dropping event network-vif-unplugged {{(pid=123563) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 16 20:42:40.788562 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-aeea73a3-2de4-4e44-b4f7-1846048ebbe7 req-910dc9bd-ad1f-4559-b0d5-540e28dec94c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.244372 May 16 20:42:40.789147 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 337/674] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 245 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 16 20:42:40.796901 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-76a2ee09-d2e6-4a87-b79f-796c9a939bc3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:42:40.797451 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-76a2ee09-d2e6-4a87-b79f-796c9a939bc3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:40.803199 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-76a2ee09-d2e6-4a87-b79f-796c9a939bc3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:40.803640 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-76a2ee09-d2e6-4a87-b79f-796c9a939bc3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:40.804401 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-76a2ee09-d2e6-4a87-b79f-796c9a939bc3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:40.804871 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-76a2ee09-d2e6-4a87-b79f-796c9a939bc3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:41.034267 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-76a2ee09-d2e6-4a87-b79f-796c9a939bc3 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "POST /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594/action" status: 202 len: 0 microversion: 2.20 time: 0.240799 May 16 20:42:41.035292 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 338/675] 10.222.0.49 () {62 vars in 1318 bytes} [Mon May 16 20:42:40 2022] POST /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 20:42:41.044941 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-3f96d76f-65ff-4e5b-be1d-f096e4db1275 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:41.046352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-3f96d76f-65ff-4e5b-be1d-f096e4db1275 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:41.052359 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3f96d76f-65ff-4e5b-be1d-f096e4db1275 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:41.052949 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3f96d76f-65ff-4e5b-be1d-f096e4db1275 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:41.053735 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3f96d76f-65ff-4e5b-be1d-f096e4db1275 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:41.054170 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3f96d76f-65ff-4e5b-be1d-f096e4db1275 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:41.220309 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-c4ddf712-a223-4239-8eb6-dba55a5e1a42 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Flavor limits 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:42:41.220809 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-c4ddf712-a223-4239-8eb6-dba55a5e1a42 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Image limits 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:42:41.221210 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-c4ddf712-a223-4239-8eb6-dba55a5e1a42 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Flavor pref 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:42:41.221778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-c4ddf712-a223-4239-8eb6-dba55a5e1a42 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Image pref 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:42:41.222069 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-c4ddf712-a223-4239-8eb6-dba55a5e1a42 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:42:41.233954 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c4ddf712-a223-4239-8eb6-dba55a5e1a42 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:41.234464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c4ddf712-a223-4239-8eb6-dba55a5e1a42 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:41.235492 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c4ddf712-a223-4239-8eb6-dba55a5e1a42 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:41.236481 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c4ddf712-a223-4239-8eb6-dba55a5e1a42 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:41.250232 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-3f96d76f-65ff-4e5b-be1d-f096e4db1275 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:41.259271 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-c4ddf712-a223-4239-8eb6-dba55a5e1a42 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Getting quotas for project 710ecde5160640149c693e0c2b0b0354. Resources: {'cores', 'ram', 'instances'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:42:41.264133 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-c4ddf712-a223-4239-8eb6-dba55a5e1a42 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Getting quotas for user 6fa431ce09e44b85b61af972bbce2ed4 and project 710ecde5160640149c693e0c2b0b0354. Resources: {'cores', 'ram', 'instances'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:42:41.269557 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-3f96d76f-65ff-4e5b-be1d-f096e4db1275 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:41.271431 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-3f96d76f-65ff-4e5b-be1d-f096e4db1275 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:41.272793 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-3f96d76f-65ff-4e5b-be1d-f096e4db1275 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1672 microversion: 2.20 time: 0.232129 May 16 20:42:41.273688 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 339/676] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:41 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1672 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:41.333267 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-c4ddf712-a223-4239-8eb6-dba55a5e1a42 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Going to run 1 instances... {{(pid=123564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:42:41.335430 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-c4ddf712-a223-4239-8eb6-dba55a5e1a42 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ef7250c7-95db-4adb-ae93-697c51aa118f',volume_size=None,volume_type=None)] {{(pid=123564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:42:41.473323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-c4ddf712-a223-4239-8eb6-dba55a5e1a42 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.011880 May 16 20:42:41.473977 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 338/677] 10.222.0.49 () {60 vars in 1146 bytes} [Mon May 16 20:42:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 20:42:41.484481 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-53f56103-764b-4087-b2ec-f6848b9cbac1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:41.485252 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-53f56103-764b-4087-b2ec-f6848b9cbac1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:41.558778 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-53f56103-764b-4087-b2ec-f6848b9cbac1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:41.567748 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-53f56103-764b-4087-b2ec-f6848b9cbac1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1094 microversion: 2.1 time: 0.087095 May 16 20:42:41.568987 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 340/678] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:41 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1094 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:42:42.291042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-2779074e-0adb-47b9-9f7f-c76758a74930 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:42.292280 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-2779074e-0adb-47b9-9f7f-c76758a74930 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:42.306818 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2779074e-0adb-47b9-9f7f-c76758a74930 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:42.307460 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2779074e-0adb-47b9-9f7f-c76758a74930 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:42.308257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2779074e-0adb-47b9-9f7f-c76758a74930 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:42.308722 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2779074e-0adb-47b9-9f7f-c76758a74930 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:42.451513 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2779074e-0adb-47b9-9f7f-c76758a74930 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:42.461440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2779074e-0adb-47b9-9f7f-c76758a74930 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:42.463746 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2779074e-0adb-47b9-9f7f-c76758a74930 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:42.465404 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-2779074e-0adb-47b9-9f7f-c76758a74930 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1672 microversion: 2.20 time: 0.178206 May 16 20:42:42.475688 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 339/679] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:42 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1672 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:42.588149 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-3557eb69-6077-4b8d-ab13-b75532d51153 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:42.590070 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-3557eb69-6077-4b8d-ab13-b75532d51153 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:42.597214 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3557eb69-6077-4b8d-ab13-b75532d51153 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:42.597662 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3557eb69-6077-4b8d-ab13-b75532d51153 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:42.598637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3557eb69-6077-4b8d-ab13-b75532d51153 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:42.599077 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3557eb69-6077-4b8d-ab13-b75532d51153 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:42.658497 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-3557eb69-6077-4b8d-ab13-b75532d51153 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:42.665777 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-3557eb69-6077-4b8d-ab13-b75532d51153 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1192 microversion: 2.1 time: 0.084898 May 16 20:42:42.666325 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 341/680] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:42 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:42.944692 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-f6e93e39-91fa-46e7-bf8a-3c57dd7f292f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:42.945563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-f6e93e39-91fa-46e7-bf8a-3c57dd7f292f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:42.952324 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f6e93e39-91fa-46e7-bf8a-3c57dd7f292f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:42.953091 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f6e93e39-91fa-46e7-bf8a-3c57dd7f292f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:42.954079 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f6e93e39-91fa-46e7-bf8a-3c57dd7f292f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:42.954708 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f6e93e39-91fa-46e7-bf8a-3c57dd7f292f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:43.044540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.objects.instance [None req-f6e93e39-91fa-46e7-bf8a-3c57dd7f292f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lazy-loading 'services' on Instance uuid faf5e096-bd76-45d5-a4cc-8a6c1cc08833 {{(pid=123564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:42:43.130695 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-f6e93e39-91fa-46e7-bf8a-3c57dd7f292f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "DELETE /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833/os-volume_attachments/134551cb-f19d-4b77-a4a7-0510ce5cfdca" status: 202 len: 0 microversion: 2.1 time: 0.189549 May 16 20:42:43.131218 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 340/681] 10.222.0.49 () {58 vars in 1415 bytes} [Mon May 16 20:42:42 2022] DELETE /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833/os-volume_attachments/134551cb-f19d-4b77-a4a7-0510ce5cfdca => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:42:43.139978 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-bb6fd3bf-c3a9-4d95-8c48-79e40dd9e976 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:43.141379 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-bb6fd3bf-c3a9-4d95-8c48-79e40dd9e976 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:43.148334 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-bb6fd3bf-c3a9-4d95-8c48-79e40dd9e976 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:43.149048 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-bb6fd3bf-c3a9-4d95-8c48-79e40dd9e976 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:43.149845 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-bb6fd3bf-c3a9-4d95-8c48-79e40dd9e976 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:43.150257 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-bb6fd3bf-c3a9-4d95-8c48-79e40dd9e976 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:43.188946 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-bb6fd3bf-c3a9-4d95-8c48-79e40dd9e976 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051646 May 16 20:42:43.190322 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 342/682] 10.222.0.49 () {58 vars in 1301 bytes} [Mon May 16 20:42:43 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:42:43.485052 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-5636a546-d9be-445b-b8a6-c3119d1fe37a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:43.486510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-5636a546-d9be-445b-b8a6-c3119d1fe37a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:43.494526 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5636a546-d9be-445b-b8a6-c3119d1fe37a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:43.494935 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5636a546-d9be-445b-b8a6-c3119d1fe37a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:43.496374 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5636a546-d9be-445b-b8a6-c3119d1fe37a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:43.496530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5636a546-d9be-445b-b8a6-c3119d1fe37a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:43.683084 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-ac50421f-ddaf-4de9-9058-e031be6a77f9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:43.683702 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-ac50421f-ddaf-4de9-9058-e031be6a77f9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:43.690605 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ac50421f-ddaf-4de9-9058-e031be6a77f9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:43.691164 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ac50421f-ddaf-4de9-9058-e031be6a77f9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:43.691949 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ac50421f-ddaf-4de9-9058-e031be6a77f9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:43.692378 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ac50421f-ddaf-4de9-9058-e031be6a77f9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:43.801035 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ac50421f-ddaf-4de9-9058-e031be6a77f9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:43.809119 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-ac50421f-ddaf-4de9-9058-e031be6a77f9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1210 microversion: 2.1 time: 0.130322 May 16 20:42:43.809699 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 343/683] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:43 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1210 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:43.872591 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-5636a546-d9be-445b-b8a6-c3119d1fe37a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:43.881521 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-5636a546-d9be-445b-b8a6-c3119d1fe37a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:43.883373 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-5636a546-d9be-445b-b8a6-c3119d1fe37a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:43.884653 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-5636a546-d9be-445b-b8a6-c3119d1fe37a tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1730 microversion: 2.20 time: 0.404939 May 16 20:42:43.885319 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 341/684] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:43 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1730 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:44.202072 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-04cc7ef3-fca2-4f23-a20b-bac6ed58b7c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:44.203265 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-04cc7ef3-fca2-4f23-a20b-bac6ed58b7c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:44.212279 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-04cc7ef3-fca2-4f23-a20b-bac6ed58b7c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:44.213022 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-04cc7ef3-fca2-4f23-a20b-bac6ed58b7c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:44.213985 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-04cc7ef3-fca2-4f23-a20b-bac6ed58b7c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:44.214672 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-04cc7ef3-fca2-4f23-a20b-bac6ed58b7c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:44.249658 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-04cc7ef3-fca2-4f23-a20b-bac6ed58b7c3 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051993 May 16 20:42:44.251002 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 344/685] 10.222.0.49 () {58 vars in 1301 bytes} [Mon May 16 20:42:44 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:42:44.826085 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-d14c8fa5-69ba-4989-af24-1d9717812775 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:44.826779 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-d14c8fa5-69ba-4989-af24-1d9717812775 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:44.836216 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d14c8fa5-69ba-4989-af24-1d9717812775 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:44.836705 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d14c8fa5-69ba-4989-af24-1d9717812775 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:44.837701 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d14c8fa5-69ba-4989-af24-1d9717812775 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:44.838400 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d14c8fa5-69ba-4989-af24-1d9717812775 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:44.905694 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-af8ecbac-f73d-4aa8-9f90-487e0140b946 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:44.906176 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-af8ecbac-f73d-4aa8-9f90-487e0140b946 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:44.916140 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-af8ecbac-f73d-4aa8-9f90-487e0140b946 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:44.916628 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-af8ecbac-f73d-4aa8-9f90-487e0140b946 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:44.917417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-af8ecbac-f73d-4aa8-9f90-487e0140b946 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:44.917853 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-af8ecbac-f73d-4aa8-9f90-487e0140b946 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:45.237181 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-af8ecbac-f73d-4aa8-9f90-487e0140b946 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:45.252302 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-d14c8fa5-69ba-4989-af24-1d9717812775 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:45.259708 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-af8ecbac-f73d-4aa8-9f90-487e0140b946 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:45.274203 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-af8ecbac-f73d-4aa8-9f90-487e0140b946 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:45.274535 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-d14c8fa5-69ba-4989-af24-1d9717812775 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1266 microversion: 2.1 time: 0.451727 May 16 20:42:45.275130 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 342/686] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:44 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1266 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:45.279714 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-af8ecbac-f73d-4aa8-9f90-487e0140b946 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1730 microversion: 2.20 time: 0.379836 May 16 20:42:45.280529 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 345/687] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:44 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1730 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:42:45.284274 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-90701d29-4524-4de2-8388-222d91278db5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:45.289727 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-90701d29-4524-4de2-8388-222d91278db5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:45.309094 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-90701d29-4524-4de2-8388-222d91278db5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:45.313629 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-90701d29-4524-4de2-8388-222d91278db5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:45.314664 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-90701d29-4524-4de2-8388-222d91278db5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:45.315109 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-90701d29-4524-4de2-8388-222d91278db5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:45.379246 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-90701d29-4524-4de2-8388-222d91278db5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102856 May 16 20:42:45.380195 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 343/688] 10.222.0.49 () {58 vars in 1301 bytes} [Mon May 16 20:42:45 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833/os-volume_attachments => generated 25 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 20:42:45.472985 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-ce7d2035-57cd-40ae-a7ac-60abe662373c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:45.473776 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-ce7d2035-57cd-40ae-a7ac-60abe662373c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:45.481279 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ce7d2035-57cd-40ae-a7ac-60abe662373c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:45.482469 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ce7d2035-57cd-40ae-a7ac-60abe662373c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:45.483604 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ce7d2035-57cd-40ae-a7ac-60abe662373c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:45.484264 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ce7d2035-57cd-40ae-a7ac-60abe662373c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:45.514302 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-ce7d2035-57cd-40ae-a7ac-60abe662373c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Going to try to terminate instance {{(pid=123563) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:42:45.689787 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-ce7d2035-57cd-40ae-a7ac-60abe662373c tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "DELETE /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 204 len: 0 microversion: 2.1 time: 0.220083 May 16 20:42:45.695378 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 346/689] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:42:45 2022] DELETE /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 20:42:45.701587 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-d25f30af-310f-463a-bc61-5a9489070ece tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:45.702331 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-d25f30af-310f-463a-bc61-5a9489070ece tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:45.713765 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d25f30af-310f-463a-bc61-5a9489070ece tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:45.716806 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d25f30af-310f-463a-bc61-5a9489070ece tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:45.719812 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d25f30af-310f-463a-bc61-5a9489070ece tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:45.720343 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d25f30af-310f-463a-bc61-5a9489070ece tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:46.017025 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-d25f30af-310f-463a-bc61-5a9489070ece tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:46.025229 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-d25f30af-310f-463a-bc61-5a9489070ece tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 200 len: 1681 microversion: 2.1 time: 0.329062 May 16 20:42:46.026316 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 344/690] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:45 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 1681 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:46.167434 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-10ab6f11-8490-4b9b-9095-f9dc4cc2f595 req-b510de8e-075e-4bcb-b157-a0994ad8e2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e0412e9-a238-47bb-8e08-de4a723b74f1", "tag": "38516439-bbc9-4e23-9ca0-a93ad3f94ec1"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:42:46.186102 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-10ab6f11-8490-4b9b-9095-f9dc4cc2f595 req-b510de8e-075e-4bcb-b157-a0994ad8e2b0 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:46.191345 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-10ab6f11-8490-4b9b-9095-f9dc4cc2f595 req-b510de8e-075e-4bcb-b157-a0994ad8e2b0 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:46.257648 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-10ab6f11-8490-4b9b-9095-f9dc4cc2f595 req-b510de8e-075e-4bcb-b157-a0994ad8e2b0 service nova] Creating event network-changed:38516439-bbc9-4e23-9ca0-a93ad3f94ec1 for instance 0e0412e9-a238-47bb-8e08-de4a723b74f1 on hv-cinder-77703 May 16 20:42:46.269402 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-10ab6f11-8490-4b9b-9095-f9dc4cc2f595 req-b510de8e-075e-4bcb-b157-a0994ad8e2b0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105973 May 16 20:42:46.273049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 347/691] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:42:46.292100 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-0e0615fd-21e3-4da3-a478-8de085600824 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:46.292762 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-0e0615fd-21e3-4da3-a478-8de085600824 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:46.303959 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-bb5bc78d-3903-4a6f-aa10-c0da81642209 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:46.304995 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-bb5bc78d-3903-4a6f-aa10-c0da81642209 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:46.323996 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0e0615fd-21e3-4da3-a478-8de085600824 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:46.324469 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0e0615fd-21e3-4da3-a478-8de085600824 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:46.343710 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-bb5bc78d-3903-4a6f-aa10-c0da81642209 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:46.344163 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-bb5bc78d-3903-4a6f-aa10-c0da81642209 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:46.344996 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-bb5bc78d-3903-4a6f-aa10-c0da81642209 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:46.345442 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-bb5bc78d-3903-4a6f-aa10-c0da81642209 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:46.347078 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0e0615fd-21e3-4da3-a478-8de085600824 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:46.347584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0e0615fd-21e3-4da3-a478-8de085600824 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:46.674781 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-bb5bc78d-3903-4a6f-aa10-c0da81642209 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:46.687876 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-bb5bc78d-3903-4a6f-aa10-c0da81642209 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:46.689692 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-bb5bc78d-3903-4a6f-aa10-c0da81642209 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:46.693811 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-bb5bc78d-3903-4a6f-aa10-c0da81642209 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1730 microversion: 2.20 time: 0.395328 May 16 20:42:46.694613 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 348/692] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:46 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1730 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:46.762960 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-0e0615fd-21e3-4da3-a478-8de085600824 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:46.774014 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-0e0615fd-21e3-4da3-a478-8de085600824 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1266 microversion: 2.1 time: 0.485955 May 16 20:42:46.784396 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 345/693] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:46 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1266 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:47.047868 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-611fc862-d5a3-4bc3-8054-8e2284e29cd2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:47.048723 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-611fc862-d5a3-4bc3-8054-8e2284e29cd2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:47.068138 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-611fc862-d5a3-4bc3-8054-8e2284e29cd2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:47.069606 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-611fc862-d5a3-4bc3-8054-8e2284e29cd2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:47.072865 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-611fc862-d5a3-4bc3-8054-8e2284e29cd2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:47.073970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-611fc862-d5a3-4bc3-8054-8e2284e29cd2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:47.335077 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-611fc862-d5a3-4bc3-8054-8e2284e29cd2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:47.346301 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-611fc862-d5a3-4bc3-8054-8e2284e29cd2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 200 len: 1681 microversion: 2.1 time: 0.306556 May 16 20:42:47.347751 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 349/694] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:47 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 1681 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:47.713151 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-67bd212b-124a-4793-a7ca-b305c7077b1d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:47.713749 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-67bd212b-124a-4793-a7ca-b305c7077b1d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:47.721147 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-67bd212b-124a-4793-a7ca-b305c7077b1d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:47.721810 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-67bd212b-124a-4793-a7ca-b305c7077b1d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:47.722925 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-67bd212b-124a-4793-a7ca-b305c7077b1d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:47.723594 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-67bd212b-124a-4793-a7ca-b305c7077b1d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:47.794415 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-ac90092f-9837-4ec3-8768-6de4f99fa2af tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:47.799532 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-ac90092f-9837-4ec3-8768-6de4f99fa2af tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:47.812685 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ac90092f-9837-4ec3-8768-6de4f99fa2af tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:47.813540 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ac90092f-9837-4ec3-8768-6de4f99fa2af tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:47.814808 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ac90092f-9837-4ec3-8768-6de4f99fa2af tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:47.815471 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ac90092f-9837-4ec3-8768-6de4f99fa2af tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:48.017423 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-67bd212b-124a-4793-a7ca-b305c7077b1d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:48.025402 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-67bd212b-124a-4793-a7ca-b305c7077b1d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:48.026924 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-67bd212b-124a-4793-a7ca-b305c7077b1d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:48.028093 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-67bd212b-124a-4793-a7ca-b305c7077b1d tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1730 microversion: 2.20 time: 0.319298 May 16 20:42:48.028721 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 346/695] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:47 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1730 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:48.114047 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ac90092f-9837-4ec3-8768-6de4f99fa2af tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:48.125324 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-ac90092f-9837-4ec3-8768-6de4f99fa2af tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1266 microversion: 2.1 time: 0.337845 May 16 20:42:48.126197 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 350/696] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:47 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1266 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:48.364168 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-feac8bfc-eab7-4d47-a726-4c4128c845d2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:48.365136 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-feac8bfc-eab7-4d47-a726-4c4128c845d2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:48.371595 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-feac8bfc-eab7-4d47-a726-4c4128c845d2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:48.372350 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-feac8bfc-eab7-4d47-a726-4c4128c845d2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:48.373586 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-feac8bfc-eab7-4d47-a726-4c4128c845d2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:48.374443 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-feac8bfc-eab7-4d47-a726-4c4128c845d2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:48.622856 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-feac8bfc-eab7-4d47-a726-4c4128c845d2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:48.635399 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-feac8bfc-eab7-4d47-a726-4c4128c845d2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 200 len: 1681 microversion: 2.1 time: 0.275897 May 16 20:42:48.646632 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 347/697] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:48 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 1681 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:49.046832 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2b8c6bae-4463-46fe-96e8-c1045d2f0977 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:49.048122 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-2b8c6bae-4463-46fe-96e8-c1045d2f0977 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:49.062564 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2b8c6bae-4463-46fe-96e8-c1045d2f0977 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:49.063256 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2b8c6bae-4463-46fe-96e8-c1045d2f0977 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:49.064223 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2b8c6bae-4463-46fe-96e8-c1045d2f0977 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:49.064831 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2b8c6bae-4463-46fe-96e8-c1045d2f0977 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:49.144316 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-b6d78cec-2099-4a21-a9b3-de6620eb328a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:49.145311 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-b6d78cec-2099-4a21-a9b3-de6620eb328a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:49.159982 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b6d78cec-2099-4a21-a9b3-de6620eb328a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:49.161314 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b6d78cec-2099-4a21-a9b3-de6620eb328a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:49.162394 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b6d78cec-2099-4a21-a9b3-de6620eb328a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:49.162989 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b6d78cec-2099-4a21-a9b3-de6620eb328a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:49.207638 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-2b8c6bae-4463-46fe-96e8-c1045d2f0977 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:49.222389 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-2b8c6bae-4463-46fe-96e8-c1045d2f0977 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:49.240474 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-2b8c6bae-4463-46fe-96e8-c1045d2f0977 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:49.242511 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-2b8c6bae-4463-46fe-96e8-c1045d2f0977 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1730 microversion: 2.20 time: 0.199162 May 16 20:42:49.262432 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 351/698] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:49 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:49.414226 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-b6d78cec-2099-4a21-a9b3-de6620eb328a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:49.424426 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-b6d78cec-2099-4a21-a9b3-de6620eb328a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1266 microversion: 2.1 time: 0.284927 May 16 20:42:49.428466 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 348/699] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:49 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:49.657837 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-88b8432e-ad88-4f33-8e23-264d387e5daa tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:49.658774 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-88b8432e-ad88-4f33-8e23-264d387e5daa tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:49.666932 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-88b8432e-ad88-4f33-8e23-264d387e5daa tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:49.667936 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-88b8432e-ad88-4f33-8e23-264d387e5daa tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:49.668983 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-88b8432e-ad88-4f33-8e23-264d387e5daa tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:49.669616 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-88b8432e-ad88-4f33-8e23-264d387e5daa tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:49.822558 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-88b8432e-ad88-4f33-8e23-264d387e5daa tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:49.830704 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-88b8432e-ad88-4f33-8e23-264d387e5daa tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 200 len: 1681 microversion: 2.1 time: 0.182271 May 16 20:42:49.840968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 352/700] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:49 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:50.261117 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-322df044-b3ba-4166-bfdf-663f629992fe tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:50.261774 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-322df044-b3ba-4166-bfdf-663f629992fe tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:50.268595 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-322df044-b3ba-4166-bfdf-663f629992fe tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:50.269045 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-322df044-b3ba-4166-bfdf-663f629992fe tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:50.277634 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-322df044-b3ba-4166-bfdf-663f629992fe tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:50.278527 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-322df044-b3ba-4166-bfdf-663f629992fe tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:50.431077 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-322df044-b3ba-4166-bfdf-663f629992fe tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:50.443758 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2fbcdca5-7ded-4481-b01c-4ae8155740e2 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:50.444385 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-2fbcdca5-7ded-4481-b01c-4ae8155740e2 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:50.447881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-322df044-b3ba-4166-bfdf-663f629992fe tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:50.452255 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2fbcdca5-7ded-4481-b01c-4ae8155740e2 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:50.453031 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2fbcdca5-7ded-4481-b01c-4ae8155740e2 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:50.454047 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2fbcdca5-7ded-4481-b01c-4ae8155740e2 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:50.454495 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2fbcdca5-7ded-4481-b01c-4ae8155740e2 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:50.455696 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-322df044-b3ba-4166-bfdf-663f629992fe tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:50.457234 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-322df044-b3ba-4166-bfdf-663f629992fe tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1730 microversion: 2.20 time: 0.200066 May 16 20:42:50.459217 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 349/701] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:50 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:42:50.616230 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-2fbcdca5-7ded-4481-b01c-4ae8155740e2 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:50.632135 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-2fbcdca5-7ded-4481-b01c-4ae8155740e2 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1266 microversion: 2.1 time: 0.193538 May 16 20:42:50.633645 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 353/702] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:50 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:42:50.848005 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-9ceb8b7b-b8a8-4157-9861-bc6bea04f228 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:50.848834 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-9ceb8b7b-b8a8-4157-9861-bc6bea04f228 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:50.855113 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9ceb8b7b-b8a8-4157-9861-bc6bea04f228 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:50.855659 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9ceb8b7b-b8a8-4157-9861-bc6bea04f228 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:50.856554 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9ceb8b7b-b8a8-4157-9861-bc6bea04f228 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:50.857052 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9ceb8b7b-b8a8-4157-9861-bc6bea04f228 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:51.018699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-9ceb8b7b-b8a8-4157-9861-bc6bea04f228 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:51.026326 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-9ceb8b7b-b8a8-4157-9861-bc6bea04f228 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 200 len: 1681 microversion: 2.1 time: 0.182223 May 16 20:42:51.026905 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 350/703] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:50 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:51.476886 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-a8b78500-4496-4d51-a15d-bc1738ad8424 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:51.477429 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-a8b78500-4496-4d51-a15d-bc1738ad8424 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:51.483796 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a8b78500-4496-4d51-a15d-bc1738ad8424 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:51.484247 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a8b78500-4496-4d51-a15d-bc1738ad8424 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:51.485195 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a8b78500-4496-4d51-a15d-bc1738ad8424 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:51.485634 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a8b78500-4496-4d51-a15d-bc1738ad8424 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:51.663075 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-daf9cb7d-22e5-4209-98b8-17ab0678b556 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:51.664495 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-daf9cb7d-22e5-4209-98b8-17ab0678b556 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:51.674101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-daf9cb7d-22e5-4209-98b8-17ab0678b556 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:51.674776 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a8b78500-4496-4d51-a15d-bc1738ad8424 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:51.675382 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-daf9cb7d-22e5-4209-98b8-17ab0678b556 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:51.677412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-daf9cb7d-22e5-4209-98b8-17ab0678b556 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:51.679729 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-daf9cb7d-22e5-4209-98b8-17ab0678b556 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:51.683865 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a8b78500-4496-4d51-a15d-bc1738ad8424 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:51.685438 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a8b78500-4496-4d51-a15d-bc1738ad8424 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:51.686859 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-a8b78500-4496-4d51-a15d-bc1738ad8424 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1730 microversion: 2.20 time: 0.214099 May 16 20:42:51.687595 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 354/704] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:51 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1730 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:51.833847 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-daf9cb7d-22e5-4209-98b8-17ab0678b556 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:51.841392 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-daf9cb7d-22e5-4209-98b8-17ab0678b556 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1266 microversion: 2.1 time: 0.191171 May 16 20:42:51.842152 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 351/705] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:51 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:42:52.043570 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-5df0ec25-546b-4be1-b7ca-ccce5ebbaf74 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:52.044200 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-5df0ec25-546b-4be1-b7ca-ccce5ebbaf74 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:52.050764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5df0ec25-546b-4be1-b7ca-ccce5ebbaf74 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:52.051213 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5df0ec25-546b-4be1-b7ca-ccce5ebbaf74 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:52.051989 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5df0ec25-546b-4be1-b7ca-ccce5ebbaf74 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:52.052413 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5df0ec25-546b-4be1-b7ca-ccce5ebbaf74 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:52.204936 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-5df0ec25-546b-4be1-b7ca-ccce5ebbaf74 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:52.218373 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-5df0ec25-546b-4be1-b7ca-ccce5ebbaf74 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 200 len: 1681 microversion: 2.1 time: 0.177761 May 16 20:42:52.220942 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 355/706] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:52 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:52.705945 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-3031a48f-53dd-4cba-8a60-be3cc9a10fd5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:52.705945 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-3031a48f-53dd-4cba-8a60-be3cc9a10fd5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:52.712829 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3031a48f-53dd-4cba-8a60-be3cc9a10fd5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:52.713484 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3031a48f-53dd-4cba-8a60-be3cc9a10fd5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:52.714407 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3031a48f-53dd-4cba-8a60-be3cc9a10fd5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:52.714863 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3031a48f-53dd-4cba-8a60-be3cc9a10fd5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:52.860624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-8651e5d4-60c0-4500-bb8b-7bcf1a893859 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:52.861236 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-8651e5d4-60c0-4500-bb8b-7bcf1a893859 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:52.870881 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8651e5d4-60c0-4500-bb8b-7bcf1a893859 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:52.871398 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8651e5d4-60c0-4500-bb8b-7bcf1a893859 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:52.872467 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8651e5d4-60c0-4500-bb8b-7bcf1a893859 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:52.873197 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8651e5d4-60c0-4500-bb8b-7bcf1a893859 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:52.892194 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3031a48f-53dd-4cba-8a60-be3cc9a10fd5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:52.901564 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3031a48f-53dd-4cba-8a60-be3cc9a10fd5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:52.907584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3031a48f-53dd-4cba-8a60-be3cc9a10fd5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:52.908937 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-3031a48f-53dd-4cba-8a60-be3cc9a10fd5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1730 microversion: 2.20 time: 0.207702 May 16 20:42:52.912122 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 352/707] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:52 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1730 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:53.047958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-8651e5d4-60c0-4500-bb8b-7bcf1a893859 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:53.063117 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-8651e5d4-60c0-4500-bb8b-7bcf1a893859 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1266 microversion: 2.1 time: 0.207129 May 16 20:42:53.064272 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 356/708] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:52 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:53.238708 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-23961378-0f33-42e4-9870-896f6b07d74f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:53.244499 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-23961378-0f33-42e4-9870-896f6b07d74f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:53.251038 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-23961378-0f33-42e4-9870-896f6b07d74f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:53.251922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-23961378-0f33-42e4-9870-896f6b07d74f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:53.253190 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-23961378-0f33-42e4-9870-896f6b07d74f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:53.253959 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-23961378-0f33-42e4-9870-896f6b07d74f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:53.394419 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-23961378-0f33-42e4-9870-896f6b07d74f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:53.402774 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-23961378-0f33-42e4-9870-896f6b07d74f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 200 len: 1681 microversion: 2.1 time: 0.169440 May 16 20:42:53.403610 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 353/709] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:53 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:53.930290 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-603c06ca-3b5e-4abd-9798-9692d2065bd6 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:53.931286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-603c06ca-3b5e-4abd-9798-9692d2065bd6 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:53.937382 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-603c06ca-3b5e-4abd-9798-9692d2065bd6 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:53.938065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-603c06ca-3b5e-4abd-9798-9692d2065bd6 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:53.939202 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-603c06ca-3b5e-4abd-9798-9692d2065bd6 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:53.939800 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-603c06ca-3b5e-4abd-9798-9692d2065bd6 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:54.077590 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-603c06ca-3b5e-4abd-9798-9692d2065bd6 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:54.078968 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-2203f715-a436-4682-9540-680931bd247e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:54.079593 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-2203f715-a436-4682-9540-680931bd247e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:54.086053 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2203f715-a436-4682-9540-680931bd247e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:54.086526 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2203f715-a436-4682-9540-680931bd247e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:54.086694 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-603c06ca-3b5e-4abd-9798-9692d2065bd6 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:54.087308 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2203f715-a436-4682-9540-680931bd247e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:54.087710 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2203f715-a436-4682-9540-680931bd247e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:54.088091 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-603c06ca-3b5e-4abd-9798-9692d2065bd6 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:54.089353 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-603c06ca-3b5e-4abd-9798-9692d2065bd6 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1730 microversion: 2.20 time: 0.163552 May 16 20:42:54.090253 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 357/710] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:53 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:54.220872 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2203f715-a436-4682-9540-680931bd247e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:54.228493 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-2203f715-a436-4682-9540-680931bd247e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1266 microversion: 2.1 time: 0.153292 May 16 20:42:54.229064 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 354/711] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:54 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:42:54.421070 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-563a4acb-7718-4305-be60-b65d35c92266 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:54.421889 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-563a4acb-7718-4305-be60-b65d35c92266 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:54.428254 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-563a4acb-7718-4305-be60-b65d35c92266 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:54.428744 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-563a4acb-7718-4305-be60-b65d35c92266 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:54.429513 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-563a4acb-7718-4305-be60-b65d35c92266 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:54.429948 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-563a4acb-7718-4305-be60-b65d35c92266 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:54.556460 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-563a4acb-7718-4305-be60-b65d35c92266 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:54.564139 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-563a4acb-7718-4305-be60-b65d35c92266 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 200 len: 1681 microversion: 2.1 time: 0.146989 May 16 20:42:54.564795 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 358/712] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:54 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:55.110506 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6ff046a8-de10-4715-b18a-7a088cda1ed2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:55.111157 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-6ff046a8-de10-4715-b18a-7a088cda1ed2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:55.117665 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6ff046a8-de10-4715-b18a-7a088cda1ed2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:55.118534 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6ff046a8-de10-4715-b18a-7a088cda1ed2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:55.118860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6ff046a8-de10-4715-b18a-7a088cda1ed2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:55.119288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6ff046a8-de10-4715-b18a-7a088cda1ed2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:55.245739 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-8f5a43b7-3fb4-4136-9f69-6ec9c85c0828 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:55.246983 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-8f5a43b7-3fb4-4136-9f69-6ec9c85c0828 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:55.254673 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8f5a43b7-3fb4-4136-9f69-6ec9c85c0828 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:55.255392 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8f5a43b7-3fb4-4136-9f69-6ec9c85c0828 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:55.256374 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8f5a43b7-3fb4-4136-9f69-6ec9c85c0828 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:55.256979 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8f5a43b7-3fb4-4136-9f69-6ec9c85c0828 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:55.356948 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6ff046a8-de10-4715-b18a-7a088cda1ed2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:55.365048 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6ff046a8-de10-4715-b18a-7a088cda1ed2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:55.366660 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6ff046a8-de10-4715-b18a-7a088cda1ed2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:55.367816 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-6ff046a8-de10-4715-b18a-7a088cda1ed2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1730 microversion: 2.20 time: 0.261336 May 16 20:42:55.368380 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 355/713] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:55 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1730 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:55.427296 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-8f5a43b7-3fb4-4136-9f69-6ec9c85c0828 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:55.435082 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-8f5a43b7-3fb4-4136-9f69-6ec9c85c0828 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1266 microversion: 2.1 time: 0.193571 May 16 20:42:55.435648 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 359/714] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:55 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:42:55.581788 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e00c80ce-5001-4d92-97f4-8f07f9a30158 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:55.582253 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-e00c80ce-5001-4d92-97f4-8f07f9a30158 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:55.588609 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e00c80ce-5001-4d92-97f4-8f07f9a30158 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:55.589059 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e00c80ce-5001-4d92-97f4-8f07f9a30158 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:55.589839 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e00c80ce-5001-4d92-97f4-8f07f9a30158 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:55.590269 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e00c80ce-5001-4d92-97f4-8f07f9a30158 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:55.715442 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e00c80ce-5001-4d92-97f4-8f07f9a30158 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:55.723251 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-e00c80ce-5001-4d92-97f4-8f07f9a30158 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 200 len: 1681 microversion: 2.1 time: 0.145563 May 16 20:42:55.723972 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 356/715] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:55 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 1681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:56.386377 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-443b035e-6b3a-4a8e-bc4f-edc3d8486cf5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:56.388064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-443b035e-6b3a-4a8e-bc4f-edc3d8486cf5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:56.398059 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-443b035e-6b3a-4a8e-bc4f-edc3d8486cf5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:56.398894 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-443b035e-6b3a-4a8e-bc4f-edc3d8486cf5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:56.399939 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-443b035e-6b3a-4a8e-bc4f-edc3d8486cf5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:56.400631 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-443b035e-6b3a-4a8e-bc4f-edc3d8486cf5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:56.451666 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-149b1ff5-209e-4249-83c5-e21821e68197 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:56.452320 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-149b1ff5-209e-4249-83c5-e21821e68197 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:56.458869 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-149b1ff5-209e-4249-83c5-e21821e68197 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:56.459380 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-149b1ff5-209e-4249-83c5-e21821e68197 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:56.460243 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-149b1ff5-209e-4249-83c5-e21821e68197 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:56.460757 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-149b1ff5-209e-4249-83c5-e21821e68197 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:57.059686 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-149b1ff5-209e-4249-83c5-e21821e68197 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:57.066415 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-443b035e-6b3a-4a8e-bc4f-edc3d8486cf5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:57.069320 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-149b1ff5-209e-4249-83c5-e21821e68197 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1266 microversion: 2.1 time: 0.622024 May 16 20:42:57.079014 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 357/716] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:56 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1266 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:42:57.079014 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-44d65e11-aafc-4c89-9218-a1d1a7584379 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:57.079014 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-44d65e11-aafc-4c89-9218-a1d1a7584379 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:57.081629 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-44d65e11-aafc-4c89-9218-a1d1a7584379 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:57.082083 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-44d65e11-aafc-4c89-9218-a1d1a7584379 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:57.082847 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-44d65e11-aafc-4c89-9218-a1d1a7584379 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:57.083289 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-44d65e11-aafc-4c89-9218-a1d1a7584379 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:57.083978 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-443b035e-6b3a-4a8e-bc4f-edc3d8486cf5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:57.085909 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-443b035e-6b3a-4a8e-bc4f-edc3d8486cf5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:57.087137 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-443b035e-6b3a-4a8e-bc4f-edc3d8486cf5 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1730 microversion: 2.20 time: 0.705565 May 16 20:42:57.088095 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 360/717] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:56 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1730 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:42:57.254008 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-44d65e11-aafc-4c89-9218-a1d1a7584379 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b578680e88c741bda2c8e56b2dc9d335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beaab3a72a345d98a9ec4e0ae4686b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:57.261716 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-44d65e11-aafc-4c89-9218-a1d1a7584379 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 200 len: 1681 microversion: 2.1 time: 0.190401 May 16 20:42:57.262293 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 358/718] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:57 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:57.584848 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-673745be-998d-47a3-929b-80faf48c3dff req-08057b15-6116-4f13-aa32-67a967c28366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faf5e096-bd76-45d5-a4cc-8a6c1cc08833", "name": "network-vif-deleted", "tag": "7cecb240-68ee-4c56-b8b3-d62a8675bc86"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:42:57.611356 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-673745be-998d-47a3-929b-80faf48c3dff req-08057b15-6116-4f13-aa32-67a967c28366 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:57.612276 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-673745be-998d-47a3-929b-80faf48c3dff req-08057b15-6116-4f13-aa32-67a967c28366 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:57.623437 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-673745be-998d-47a3-929b-80faf48c3dff req-08057b15-6116-4f13-aa32-67a967c28366 service nova] Creating event network-vif-deleted:7cecb240-68ee-4c56-b8b3-d62a8675bc86 for instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 on hv-cinder-77703 May 16 20:42:57.629163 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-673745be-998d-47a3-929b-80faf48c3dff req-08057b15-6116-4f13-aa32-67a967c28366 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050063 May 16 20:42:57.630367 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 361/719] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:42:58.086101 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-3fef357c-dd41-4b6c-8d9b-ccf8c22c6d2c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:58.087346 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-3fef357c-dd41-4b6c-8d9b-ccf8c22c6d2c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:58.094112 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3fef357c-dd41-4b6c-8d9b-ccf8c22c6d2c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:58.094808 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3fef357c-dd41-4b6c-8d9b-ccf8c22c6d2c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:58.095777 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3fef357c-dd41-4b6c-8d9b-ccf8c22c6d2c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:58.096371 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3fef357c-dd41-4b6c-8d9b-ccf8c22c6d2c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:58.111021 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-1e08433e-92ce-4bc3-9eda-35aad9e7dee2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:58.113612 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-1e08433e-92ce-4bc3-9eda-35aad9e7dee2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:58.127137 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1e08433e-92ce-4bc3-9eda-35aad9e7dee2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:58.127823 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1e08433e-92ce-4bc3-9eda-35aad9e7dee2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:58.129056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1e08433e-92ce-4bc3-9eda-35aad9e7dee2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:58.129899 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1e08433e-92ce-4bc3-9eda-35aad9e7dee2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:58.311717 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3fef357c-dd41-4b6c-8d9b-ccf8c22c6d2c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:58.318985 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-1e08433e-92ce-4bc3-9eda-35aad9e7dee2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:58.321214 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-3fef357c-dd41-4b6c-8d9b-ccf8c22c6d2c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1266 microversion: 2.1 time: 0.239060 May 16 20:42:58.327528 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-1e08433e-92ce-4bc3-9eda-35aad9e7dee2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:58.329358 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-1e08433e-92ce-4bc3-9eda-35aad9e7dee2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:58.330604 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-1e08433e-92ce-4bc3-9eda-35aad9e7dee2 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1730 microversion: 2.20 time: 0.225521 May 16 20:42:58.331079 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 359/720] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:58 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:58.331548 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 362/721] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:58 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1730 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 20:42:58.337392 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-4c0d9967-ce7e-411a-8af5-e43b5bcddbd6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:58.337998 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-4c0d9967-ce7e-411a-8af5-e43b5bcddbd6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:58.344418 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4c0d9967-ce7e-411a-8af5-e43b5bcddbd6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:58.344930 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4c0d9967-ce7e-411a-8af5-e43b5bcddbd6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:58.345689 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4c0d9967-ce7e-411a-8af5-e43b5bcddbd6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:58.346124 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4c0d9967-ce7e-411a-8af5-e43b5bcddbd6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:58.361280 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-4c0d9967-ce7e-411a-8af5-e43b5bcddbd6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] HTTP exception thrown: Instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 could not be found. May 16 20:42:58.362934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-4c0d9967-ce7e-411a-8af5-e43b5bcddbd6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Request method failure captured: May 16 20:42:58.362934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 HTTP/1.1 May 16 20:42:58.362934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:42:58.362934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:42:58.362934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:42:58.362934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:42:58.362934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:42:58.362934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:42:58.362934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:42:58.362934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:42:58.362934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrXoPH7QRaaUNABjfpjkYuYjuc4YT0JGIT87HUhaS5B5EXLX9gs5SGdefatz8rk10ofLrDlfVl0DHS_o7l3BlYtbJjSH31X6xpm4OYuntjQCYXgO_XFh2HlouaxMKjcOnmFJvaHNJ-XXm3gC4mA2DpJBa428rLJJY3RCeZ4NRvaKM9I May 16 20:42:58.362934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:42:58.362934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:42:58.362934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:42:58.362934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:42:58.362934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:42:58.362934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:42:58.362934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:42:58.362934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:42:58.362934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:42:58.362934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:42:58.364558 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}] May 16 20:42:58.364558 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:42:58.364558 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:42:58.364558 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:42:58.364558 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:42:58.364558 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:42:58.364558 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:42:58.364558 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: b578680e88c741bda2c8e56b2dc9d335 May 16 20:42:58.364558 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:42:58.364558 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:42:58.364558 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 could not be found. May 16 20:42:58.364558 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': 'faf5e096-bd76-45d5-a4cc-8a6c1cc08833'} May 16 20:42:58.365624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:42:58.365624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:42:58.365624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:42:58.365624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:42:58.365624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:42:58.365624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:42:58.365624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:42:58.365624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:42:58.365624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:42:58.365624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:42:58.365624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 could not be found. May 16 20:42:58.365624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:58.365624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:42:58.365624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:58.365624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:42:58.365624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:42:58.365624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:42:58.365624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:42:58.365624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:42:58.365624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:42:58.367256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:42:58.367256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:42:58.367256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:42:58.367256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:42:58.367256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:42:58.367256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:42:58.367256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:42:58.367256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 could not be found. May 16 20:42:58.367256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:58.367256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:42:58.367256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:58.367256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:42:58.367256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:42:58.367256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:42:58.367256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:42:58.367256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:42:58.367256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 could not be found. May 16 20:42:58.367256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:42:58.368813 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-4c0d9967-ce7e-411a-8af5-e43b5bcddbd6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Returning 404 to user: Instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:42:58.368813 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-4c0d9967-ce7e-411a-8af5-e43b5bcddbd6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 404 len: 111 microversion: 2.1 time: 0.030750 May 16 20:42:58.368813 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 360/722] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:58 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:42:58.373724 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-c254060b-3652-4870-953e-b251e29d9c0f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '.version_select at 0x7f81b11eba60>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:58.391880 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-c254060b-3652-4870-953e-b251e29d9c0f tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1204171031" status: 202 len: 0 microversion: 2.1 time: 0.021930 May 16 20:42:58.392495 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 363/723] 10.222.0.49 () {58 vars in 1220 bytes} [Mon May 16 20:42:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1204171031 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:42:59.338418 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-46f35eb4-974b-44a9-b377-08c9164b0c58 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:59.339060 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-46f35eb4-974b-44a9-b377-08c9164b0c58 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:59.345405 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-46f35eb4-974b-44a9-b377-08c9164b0c58 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:59.345847 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-46f35eb4-974b-44a9-b377-08c9164b0c58 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:59.346604 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-46f35eb4-974b-44a9-b377-08c9164b0c58 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:59.347033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-46f35eb4-974b-44a9-b377-08c9164b0c58 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:59.348990 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-b666fe7f-d29a-4859-a5f7-d586eb029b4e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:42:59.349608 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-b666fe7f-d29a-4859-a5f7-d586eb029b4e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:42:59.355601 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b666fe7f-d29a-4859-a5f7-d586eb029b4e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:59.356057 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b666fe7f-d29a-4859-a5f7-d586eb029b4e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:59.356872 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b666fe7f-d29a-4859-a5f7-d586eb029b4e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:42:59.357345 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b666fe7f-d29a-4859-a5f7-d586eb029b4e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:42:59.547690 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-46f35eb4-974b-44a9-b377-08c9164b0c58 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:59.551970 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-b666fe7f-d29a-4859-a5f7-d586eb029b4e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:59.555262 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-46f35eb4-974b-44a9-b377-08c9164b0c58 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1266 microversion: 2.1 time: 0.220743 May 16 20:42:59.555821 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 361/724] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:42:59 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:42:59.560746 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-b666fe7f-d29a-4859-a5f7-d586eb029b4e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:59.562303 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-b666fe7f-d29a-4859-a5f7-d586eb029b4e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:42:59.563472 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-b666fe7f-d29a-4859-a5f7-d586eb029b4e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1730 microversion: 2.20 time: 0.218972 May 16 20:42:59.564017 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 364/725] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:42:59 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:43:00.230398 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-d236597c-d5d8-45ba-9a06-e822c67b3b00 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:00.230971 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-d236597c-d5d8-45ba-9a06-e822c67b3b00 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:00.237175 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d236597c-d5d8-45ba-9a06-e822c67b3b00 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:00.237651 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d236597c-d5d8-45ba-9a06-e822c67b3b00 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:00.238424 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d236597c-d5d8-45ba-9a06-e822c67b3b00 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:00.238865 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d236597c-d5d8-45ba-9a06-e822c67b3b00 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:00.252250 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-d236597c-d5d8-45ba-9a06-e822c67b3b00 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] HTTP exception thrown: Instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 could not be found. May 16 20:43:00.253823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-d236597c-d5d8-45ba-9a06-e822c67b3b00 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Request method failure captured: May 16 20:43:00.253823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: DELETE /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 HTTP/1.1 May 16 20:43:00.253823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:43:00.253823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:43:00.253823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:43:00.253823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:43:00.253823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:43:00.253823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:43:00.253823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:43:00.253823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:43:00.253823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrXoPH7QRaaUNABjfpjkYuYjuc4YT0JGIT87HUhaS5B5EXLX9gs5SGdefatz8rk10ofLrDlfVl0DHS_o7l3BlYtbJjSH31X6xpm4OYuntjQCYXgO_XFh2HlouaxMKjcOnmFJvaHNJ-XXm3gC4mA2DpJBa428rLJJY3RCeZ4NRvaKM9I May 16 20:43:00.253823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:43:00.253823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:43:00.253823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:43:00.253823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:43:00.253823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:43:00.253823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:43:00.253823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:43:00.253823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:00.253823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:43:00.253823 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:43:00.255440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}] May 16 20:43:00.255440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:00.255440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:43:00.255440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:00.255440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:43:00.255440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:43:00.255440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:43:00.255440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: b578680e88c741bda2c8e56b2dc9d335 May 16 20:43:00.255440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:43:00.255440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:43:00.255440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 could not be found. May 16 20:43:00.255440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': 'faf5e096-bd76-45d5-a4cc-8a6c1cc08833'} May 16 20:43:00.256420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:43:00.256420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:00.256420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:43:00.256420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:43:00.256420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:43:00.256420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:43:00.256420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:43:00.256420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:43:00.256420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:43:00.256420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:43:00.256420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 could not be found. May 16 20:43:00.256420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:00.256420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:00.256420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:00.256420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:00.256420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:00.256420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:00.256420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:43:00.256420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:43:00.256420 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:43:00.257913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:43:00.257913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 20:43:00.257913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 20:43:00.257913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 20:43:00.257913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 20:43:00.257913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:43:00.257913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:43:00.257913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:43:00.257913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:43:00.257913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 could not be found. May 16 20:43:00.257913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:00.257913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:00.257913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:00.257913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:00.257913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:00.257913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:00.257913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:43:00.257913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:43:00.257913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 could not be found. May 16 20:43:00.257913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:00.259454 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-d236597c-d5d8-45ba-9a06-e822c67b3b00 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Returning 404 to user: Instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:43:00.259454 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-d236597c-d5d8-45ba-9a06-e822c67b3b00 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "DELETE /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 404 len: 111 microversion: 2.1 time: 0.029027 May 16 20:43:00.259454 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 362/726] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:43:00 2022] DELETE /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:43:00.263635 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-09a7a142-ffbf-42c6-a8f2-59f28fd4048b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:00.264251 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-09a7a142-ffbf-42c6-a8f2-59f28fd4048b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: faf5e096-bd76-45d5-a4cc-8a6c1cc08833] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:00.270387 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-09a7a142-ffbf-42c6-a8f2-59f28fd4048b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:00.270803 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-09a7a142-ffbf-42c6-a8f2-59f28fd4048b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:00.271616 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-09a7a142-ffbf-42c6-a8f2-59f28fd4048b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:00.272051 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-09a7a142-ffbf-42c6-a8f2-59f28fd4048b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:00.286005 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-09a7a142-ffbf-42c6-a8f2-59f28fd4048b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] HTTP exception thrown: Instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 could not be found. May 16 20:43:00.287711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-09a7a142-ffbf-42c6-a8f2-59f28fd4048b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Request method failure captured: May 16 20:43:00.287711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 HTTP/1.1 May 16 20:43:00.287711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:43:00.287711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:43:00.287711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:43:00.287711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:43:00.287711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:43:00.287711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:43:00.287711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:43:00.287711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:43:00.287711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrXoPH7QRaaUNABjfpjkYuYjuc4YT0JGIT87HUhaS5B5EXLX9gs5SGdefatz8rk10ofLrDlfVl0DHS_o7l3BlYtbJjSH31X6xpm4OYuntjQCYXgO_XFh2HlouaxMKjcOnmFJvaHNJ-XXm3gC4mA2DpJBa428rLJJY3RCeZ4NRvaKM9I May 16 20:43:00.287711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:43:00.287711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:43:00.287711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:43:00.287711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:43:00.287711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:43:00.287711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:43:00.287711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:43:00.287711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:00.287711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:43:00.287711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:43:00.289287 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}] May 16 20:43:00.289287 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:00.289287 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:43:00.289287 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:00.289287 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:43:00.289287 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:43:00.289287 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:43:00.289287 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: b578680e88c741bda2c8e56b2dc9d335 May 16 20:43:00.289287 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:43:00.289287 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: > May 16 20:43:00.289287 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 could not be found. May 16 20:43:00.289287 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': 'faf5e096-bd76-45d5-a4cc-8a6c1cc08833'} May 16 20:43:00.290174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:43:00.290174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:00.290174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:43:00.290174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:43:00.290174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:43:00.290174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:43:00.290174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:43:00.290174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:43:00.290174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:43:00.290174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:43:00.290174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 could not be found. May 16 20:43:00.290174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:00.290174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:00.290174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:00.290174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:00.290174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:00.290174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:00.290174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:43:00.290174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:43:00.290174 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:43:00.291598 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:43:00.291598 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:43:00.291598 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:43:00.291598 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:43:00.291598 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:43:00.291598 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:43:00.291598 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:43:00.291598 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 could not be found. May 16 20:43:00.291598 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:00.291598 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:00.291598 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:00.291598 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:00.291598 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:00.291598 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:00.291598 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:43:00.291598 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:43:00.291598 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 could not be found. May 16 20:43:00.291598 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:00.292843 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-09a7a142-ffbf-42c6-a8f2-59f28fd4048b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Returning 404 to user: Instance faf5e096-bd76-45d5-a4cc-8a6c1cc08833 could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:43:00.292843 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-09a7a142-ffbf-42c6-a8f2-59f28fd4048b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833" status: 404 len: 111 microversion: 2.1 time: 0.029363 May 16 20:43:00.293229 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 365/727] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:00 2022] GET /compute/v2.1/servers/faf5e096-bd76-45d5-a4cc-8a6c1cc08833 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:43:00.572824 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a0d4a028-b899-4a4e-8894-afdacb3aa776 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:00.573663 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-a0d4a028-b899-4a4e-8894-afdacb3aa776 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:00.583473 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-e15a570e-3f97-414c-b173-5e230adf810e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:00.584872 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-e15a570e-3f97-414c-b173-5e230adf810e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:00.596015 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e15a570e-3f97-414c-b173-5e230adf810e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:00.597052 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e15a570e-3f97-414c-b173-5e230adf810e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:00.598781 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a0d4a028-b899-4a4e-8894-afdacb3aa776 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:00.599447 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a0d4a028-b899-4a4e-8894-afdacb3aa776 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:00.600638 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a0d4a028-b899-4a4e-8894-afdacb3aa776 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:00.601277 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e15a570e-3f97-414c-b173-5e230adf810e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:00.601700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e15a570e-3f97-414c-b173-5e230adf810e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:00.606292 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a0d4a028-b899-4a4e-8894-afdacb3aa776 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:00.807980 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-e15a570e-3f97-414c-b173-5e230adf810e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:00.812386 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a0d4a028-b899-4a4e-8894-afdacb3aa776 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:00.816254 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-e15a570e-3f97-414c-b173-5e230adf810e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:00.817972 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-e15a570e-3f97-414c-b173-5e230adf810e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:00.819316 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-e15a570e-3f97-414c-b173-5e230adf810e tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1730 microversion: 2.20 time: 0.241581 May 16 20:43:00.819950 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-a0d4a028-b899-4a4e-8894-afdacb3aa776 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1266 microversion: 2.1 time: 0.251516 May 16 20:43:00.820197 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 366/728] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:43:00 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:43:00.824878 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-9b5d5773-bdeb-4bec-8313-c85923a7ca29 req-13a1a52c-1f05-45ae-94af-972261097e0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1718fbf6-1460-443d-9fb4-815bf062c594", "name": "network-vif-plugged", "status": "completed", "tag": "21b40ca4-40ac-4a3f-9958-fe3007671e02"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:43:00.830277 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 363/729] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:00 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:00.833778 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-9b5d5773-bdeb-4bec-8313-c85923a7ca29 req-13a1a52c-1f05-45ae-94af-972261097e0e service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:00.834281 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-9b5d5773-bdeb-4bec-8313-c85923a7ca29 req-13a1a52c-1f05-45ae-94af-972261097e0e service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:00.845179 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-9b5d5773-bdeb-4bec-8313-c85923a7ca29 req-13a1a52c-1f05-45ae-94af-972261097e0e service nova] Creating event network-vif-plugged:21b40ca4-40ac-4a3f-9958-fe3007671e02 for instance 1718fbf6-1460-443d-9fb4-815bf062c594 on hv-cinder-77703 May 16 20:43:00.850301 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-9b5d5773-bdeb-4bec-8313-c85923a7ca29 req-13a1a52c-1f05-45ae-94af-972261097e0e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028805 May 16 20:43:00.850872 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 367/730] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:43:01.422365 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-be9a97c2-313d-4884-ba2e-74a340d207ed tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:01.422889 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-be9a97c2-313d-4884-ba2e-74a340d207ed tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:01.429177 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-be9a97c2-313d-4884-ba2e-74a340d207ed tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:01.429627 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-be9a97c2-313d-4884-ba2e-74a340d207ed tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:01.430403 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-be9a97c2-313d-4884-ba2e-74a340d207ed tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:01.430819 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-be9a97c2-313d-4884-ba2e-74a340d207ed tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:01.444385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-be9a97c2-313d-4884-ba2e-74a340d207ed tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] HTTP exception thrown: Instance c5cee6b8-329b-4d56-b979-3fa246901f31 could not be found. May 16 20:43:01.445949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-be9a97c2-313d-4884-ba2e-74a340d207ed tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Request method failure captured: May 16 20:43:01.445949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: DELETE /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 HTTP/1.1 May 16 20:43:01.445949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:43:01.445949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:43:01.445949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:43:01.445949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:43:01.445949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:43:01.445949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:43:01.445949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:43:01.445949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:43:01.445949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrXoPH7QRaaUNABjfpjkYuYjuc4YT0JGIT87HUhaS5B5EXLX9gs5SGdefatz8rk10ofLrDlfVl0DHS_o7l3BlYtbJjSH31X6xpm4OYuntjQCYXgO_XFh2HlouaxMKjcOnmFJvaHNJ-XXm3gC4mA2DpJBa428rLJJY3RCeZ4NRvaKM9I May 16 20:43:01.445949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:43:01.445949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:43:01.445949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:43:01.445949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:43:01.445949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:43:01.445949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:43:01.445949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:43:01.445949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:01.445949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:43:01.445949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:43:01.447522 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}] May 16 20:43:01.447522 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:01.447522 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:43:01.447522 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:01.447522 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:43:01.447522 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:43:01.447522 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:43:01.447522 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: b578680e88c741bda2c8e56b2dc9d335 May 16 20:43:01.447522 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:43:01.447522 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:43:01.447522 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance c5cee6b8-329b-4d56-b979-3fa246901f31 could not be found. May 16 20:43:01.447522 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': 'c5cee6b8-329b-4d56-b979-3fa246901f31'} May 16 20:43:01.448406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:43:01.448406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:01.448406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:43:01.448406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:43:01.448406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:43:01.448406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:43:01.448406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:43:01.448406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:43:01.448406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:43:01.448406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:43:01.448406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5cee6b8-329b-4d56-b979-3fa246901f31 could not be found. May 16 20:43:01.448406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:01.448406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:01.448406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:01.448406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:01.448406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:01.448406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:01.448406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:43:01.448406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:43:01.448406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:43:01.449914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:43:01.449914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 20:43:01.449914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 20:43:01.449914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 20:43:01.449914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 20:43:01.449914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:43:01.449914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:43:01.449914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:43:01.449914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:43:01.449914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5cee6b8-329b-4d56-b979-3fa246901f31 could not be found. May 16 20:43:01.449914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:01.449914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:01.449914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:01.449914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:01.449914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:01.449914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:01.449914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:43:01.449914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:43:01.449914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5cee6b8-329b-4d56-b979-3fa246901f31 could not be found. May 16 20:43:01.449914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:01.451643 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-be9a97c2-313d-4884-ba2e-74a340d207ed tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Returning 404 to user: Instance c5cee6b8-329b-4d56-b979-3fa246901f31 could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:43:01.451643 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-be9a97c2-313d-4884-ba2e-74a340d207ed tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31" status: 404 len: 111 microversion: 2.1 time: 0.028947 May 16 20:43:01.451643 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 364/731] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:43:01 2022] DELETE /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:43:01.457038 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-9b963253-2d2a-4faa-a058-779373c4c1d6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:01.457804 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-9b963253-2d2a-4faa-a058-779373c4c1d6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: c5cee6b8-329b-4d56-b979-3fa246901f31] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:01.466877 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9b963253-2d2a-4faa-a058-779373c4c1d6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:01.466877 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9b963253-2d2a-4faa-a058-779373c4c1d6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:01.466877 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9b963253-2d2a-4faa-a058-779373c4c1d6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:01.466877 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9b963253-2d2a-4faa-a058-779373c4c1d6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:01.480555 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-9b963253-2d2a-4faa-a058-779373c4c1d6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] HTTP exception thrown: Instance c5cee6b8-329b-4d56-b979-3fa246901f31 could not be found. May 16 20:43:01.482271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-9b963253-2d2a-4faa-a058-779373c4c1d6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Request method failure captured: May 16 20:43:01.482271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 HTTP/1.1 May 16 20:43:01.482271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:43:01.482271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:43:01.482271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:43:01.482271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:43:01.482271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:43:01.482271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:43:01.482271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:43:01.482271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:43:01.482271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrXoPH7QRaaUNABjfpjkYuYjuc4YT0JGIT87HUhaS5B5EXLX9gs5SGdefatz8rk10ofLrDlfVl0DHS_o7l3BlYtbJjSH31X6xpm4OYuntjQCYXgO_XFh2HlouaxMKjcOnmFJvaHNJ-XXm3gC4mA2DpJBa428rLJJY3RCeZ4NRvaKM9I May 16 20:43:01.482271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:43:01.482271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:43:01.482271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:43:01.482271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:43:01.482271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:43:01.482271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:43:01.482271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:43:01.482271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:01.482271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:43:01.482271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:43:01.483985 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}] May 16 20:43:01.483985 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:01.483985 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:43:01.483985 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:01.483985 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:43:01.483985 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:43:01.483985 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:43:01.483985 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: b578680e88c741bda2c8e56b2dc9d335 May 16 20:43:01.483985 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:43:01.483985 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: > May 16 20:43:01.483985 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Instance c5cee6b8-329b-4d56-b979-3fa246901f31 could not be found. May 16 20:43:01.483985 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': 'c5cee6b8-329b-4d56-b979-3fa246901f31'} May 16 20:43:01.485065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:43:01.485065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:01.485065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:43:01.485065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:43:01.485065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:43:01.485065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:43:01.485065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:43:01.485065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:43:01.485065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:43:01.485065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:43:01.485065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5cee6b8-329b-4d56-b979-3fa246901f31 could not be found. May 16 20:43:01.485065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:01.485065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:01.485065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:01.485065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:01.485065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:01.485065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:01.485065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:43:01.485065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:43:01.485065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:43:01.487637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:43:01.487637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:43:01.487637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:43:01.487637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:43:01.487637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:43:01.487637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:43:01.487637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:43:01.487637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5cee6b8-329b-4d56-b979-3fa246901f31 could not be found. May 16 20:43:01.487637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:01.487637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:01.487637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:01.487637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:01.487637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:01.487637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:01.487637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:43:01.487637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:43:01.487637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5cee6b8-329b-4d56-b979-3fa246901f31 could not be found. May 16 20:43:01.487637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:01.488958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-9b963253-2d2a-4faa-a058-779373c4c1d6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Returning 404 to user: Instance c5cee6b8-329b-4d56-b979-3fa246901f31 could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:43:01.488958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-9b963253-2d2a-4faa-a058-779373c4c1d6 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31" status: 404 len: 111 microversion: 2.1 time: 0.032427 May 16 20:43:01.488958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 368/732] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:01 2022] GET /compute/v2.1/servers/c5cee6b8-329b-4d56-b979-3fa246901f31 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 20:43:01.493788 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-39a6c506-8b3a-4dd5-a765-2cc230180fc2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:01.494404 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-39a6c506-8b3a-4dd5-a765-2cc230180fc2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:01.500706 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-39a6c506-8b3a-4dd5-a765-2cc230180fc2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:01.501158 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-39a6c506-8b3a-4dd5-a765-2cc230180fc2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:01.501929 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-39a6c506-8b3a-4dd5-a765-2cc230180fc2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:01.502367 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-39a6c506-8b3a-4dd5-a765-2cc230180fc2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:01.516778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-39a6c506-8b3a-4dd5-a765-2cc230180fc2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] HTTP exception thrown: Instance 36eca126-3242-483f-a941-432265ebaf50 could not be found. May 16 20:43:01.518288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-39a6c506-8b3a-4dd5-a765-2cc230180fc2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Request method failure captured: May 16 20:43:01.518288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: DELETE /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 HTTP/1.1 May 16 20:43:01.518288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:43:01.518288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:43:01.518288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:43:01.518288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:43:01.518288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:43:01.518288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:43:01.518288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:43:01.518288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:43:01.518288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrXoPH7QRaaUNABjfpjkYuYjuc4YT0JGIT87HUhaS5B5EXLX9gs5SGdefatz8rk10ofLrDlfVl0DHS_o7l3BlYtbJjSH31X6xpm4OYuntjQCYXgO_XFh2HlouaxMKjcOnmFJvaHNJ-XXm3gC4mA2DpJBa428rLJJY3RCeZ4NRvaKM9I May 16 20:43:01.518288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:43:01.518288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:43:01.518288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:43:01.518288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:43:01.518288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:43:01.518288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:43:01.518288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:43:01.518288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:01.518288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:43:01.518288 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:43:01.520041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}] May 16 20:43:01.520041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:01.520041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:43:01.520041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:01.520041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:43:01.520041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:43:01.520041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:43:01.520041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: b578680e88c741bda2c8e56b2dc9d335 May 16 20:43:01.520041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:43:01.520041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:43:01.520041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance 36eca126-3242-483f-a941-432265ebaf50 could not be found. May 16 20:43:01.520041 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': '36eca126-3242-483f-a941-432265ebaf50'} May 16 20:43:01.520984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:43:01.520984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:01.520984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:43:01.520984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:43:01.520984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:43:01.520984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:43:01.520984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:43:01.520984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:43:01.520984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:43:01.520984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:43:01.520984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36eca126-3242-483f-a941-432265ebaf50 could not be found. May 16 20:43:01.520984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:01.520984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:01.520984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:01.520984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:01.520984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:01.520984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:01.520984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:43:01.520984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:43:01.520984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:43:01.522385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:43:01.522385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 20:43:01.522385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 20:43:01.522385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 20:43:01.522385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 20:43:01.522385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:43:01.522385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:43:01.522385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:43:01.522385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:43:01.522385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36eca126-3242-483f-a941-432265ebaf50 could not be found. May 16 20:43:01.522385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:01.522385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:01.522385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:01.522385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:01.522385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:01.522385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:01.522385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:43:01.522385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:43:01.522385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36eca126-3242-483f-a941-432265ebaf50 could not be found. May 16 20:43:01.522385 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:01.523957 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-39a6c506-8b3a-4dd5-a765-2cc230180fc2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Returning 404 to user: Instance 36eca126-3242-483f-a941-432265ebaf50 could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:43:01.523957 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-39a6c506-8b3a-4dd5-a765-2cc230180fc2 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "DELETE /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 404 len: 111 microversion: 2.1 time: 0.029812 May 16 20:43:01.523957 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 365/733] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:43:01 2022] DELETE /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 20:43:01.528293 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-d3582b87-5ae0-4e4d-8d58-cce587d10ef5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:01.528926 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-d3582b87-5ae0-4e4d-8d58-cce587d10ef5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: 36eca126-3242-483f-a941-432265ebaf50] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:01.535271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d3582b87-5ae0-4e4d-8d58-cce587d10ef5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:01.535718 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d3582b87-5ae0-4e4d-8d58-cce587d10ef5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:01.536568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d3582b87-5ae0-4e4d-8d58-cce587d10ef5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:01.537069 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d3582b87-5ae0-4e4d-8d58-cce587d10ef5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:01.550655 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-d3582b87-5ae0-4e4d-8d58-cce587d10ef5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] HTTP exception thrown: Instance 36eca126-3242-483f-a941-432265ebaf50 could not be found. May 16 20:43:01.552175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-d3582b87-5ae0-4e4d-8d58-cce587d10ef5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Request method failure captured: May 16 20:43:01.552175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 HTTP/1.1 May 16 20:43:01.552175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:43:01.552175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:43:01.552175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:43:01.552175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:43:01.552175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:43:01.552175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:43:01.552175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:43:01.552175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:43:01.552175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrXoPH7QRaaUNABjfpjkYuYjuc4YT0JGIT87HUhaS5B5EXLX9gs5SGdefatz8rk10ofLrDlfVl0DHS_o7l3BlYtbJjSH31X6xpm4OYuntjQCYXgO_XFh2HlouaxMKjcOnmFJvaHNJ-XXm3gC4mA2DpJBa428rLJJY3RCeZ4NRvaKM9I May 16 20:43:01.552175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:43:01.552175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:43:01.552175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:43:01.552175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:43:01.552175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:43:01.552175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:43:01.552175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:43:01.552175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:01.552175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:43:01.552175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:43:01.553811 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}] May 16 20:43:01.553811 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:01.553811 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:43:01.553811 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:01.553811 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:43:01.553811 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:43:01.553811 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:43:01.553811 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: b578680e88c741bda2c8e56b2dc9d335 May 16 20:43:01.553811 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:43:01.553811 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: > May 16 20:43:01.553811 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Instance 36eca126-3242-483f-a941-432265ebaf50 could not be found. May 16 20:43:01.553811 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': '36eca126-3242-483f-a941-432265ebaf50'} May 16 20:43:01.555042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:43:01.555042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:01.555042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:43:01.555042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:43:01.555042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:43:01.555042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:43:01.555042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:43:01.555042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:43:01.555042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:43:01.555042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:43:01.555042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36eca126-3242-483f-a941-432265ebaf50 could not be found. May 16 20:43:01.555042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:01.555042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:01.555042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:01.555042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:01.555042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:01.555042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:01.555042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:43:01.555042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:43:01.555042 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:43:01.556660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:43:01.556660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:43:01.556660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:43:01.556660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:43:01.556660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:43:01.556660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:43:01.556660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:43:01.556660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36eca126-3242-483f-a941-432265ebaf50 could not be found. May 16 20:43:01.556660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:01.556660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:01.556660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:01.556660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:01.556660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:01.556660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:01.556660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:43:01.556660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:43:01.556660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36eca126-3242-483f-a941-432265ebaf50 could not be found. May 16 20:43:01.556660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:01.558319 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-d3582b87-5ae0-4e4d-8d58-cce587d10ef5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Returning 404 to user: Instance 36eca126-3242-483f-a941-432265ebaf50 could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:43:01.558319 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-d3582b87-5ae0-4e4d-8d58-cce587d10ef5 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50" status: 404 len: 111 microversion: 2.1 time: 0.029172 May 16 20:43:01.558319 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 369/734] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:01 2022] GET /compute/v2.1/servers/36eca126-3242-483f-a941-432265ebaf50 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:43:01.837901 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-bee1de8f-4323-457d-8e34-370fb13207e7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:01.838566 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-bee1de8f-4323-457d-8e34-370fb13207e7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:01.845438 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bee1de8f-4323-457d-8e34-370fb13207e7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:01.845892 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bee1de8f-4323-457d-8e34-370fb13207e7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:01.846611 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-49d92533-1d0d-4328-bf6b-fc54ad8daa45 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:01.847104 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bee1de8f-4323-457d-8e34-370fb13207e7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:01.847212 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bee1de8f-4323-457d-8e34-370fb13207e7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:01.847310 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-49d92533-1d0d-4328-bf6b-fc54ad8daa45 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:01.854604 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-49d92533-1d0d-4328-bf6b-fc54ad8daa45 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:01.855125 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-49d92533-1d0d-4328-bf6b-fc54ad8daa45 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:01.855992 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-49d92533-1d0d-4328-bf6b-fc54ad8daa45 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:01.857962 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-49d92533-1d0d-4328-bf6b-fc54ad8daa45 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:02.054761 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-49d92533-1d0d-4328-bf6b-fc54ad8daa45 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:02.059421 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-bee1de8f-4323-457d-8e34-370fb13207e7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:02.070965 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-bee1de8f-4323-457d-8e34-370fb13207e7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:02.073117 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-bee1de8f-4323-457d-8e34-370fb13207e7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:02.074762 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-49d92533-1d0d-4328-bf6b-fc54ad8daa45 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1266 microversion: 2.1 time: 0.231855 May 16 20:43:02.075414 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-bee1de8f-4323-457d-8e34-370fb13207e7 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1730 microversion: 2.20 time: 0.241316 May 16 20:43:02.076308 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 366/735] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:43:01 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:43:02.084275 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 370/736] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:01 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:02.690384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-de574c06-6f02-4aab-81da-660475165044 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:02.691138 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-de574c06-6f02-4aab-81da-660475165044 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:02.697772 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-de574c06-6f02-4aab-81da-660475165044 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:02.698332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-de574c06-6f02-4aab-81da-660475165044 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:02.699109 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-de574c06-6f02-4aab-81da-660475165044 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:02.699533 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-de574c06-6f02-4aab-81da-660475165044 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:02.712983 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-de574c06-6f02-4aab-81da-660475165044 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] HTTP exception thrown: Instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 could not be found. May 16 20:43:02.714562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-de574c06-6f02-4aab-81da-660475165044 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Request method failure captured: May 16 20:43:02.714562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: DELETE /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 HTTP/1.1 May 16 20:43:02.714562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:43:02.714562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:43:02.714562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:43:02.714562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:43:02.714562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:43:02.714562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:43:02.714562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:43:02.714562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:43:02.714562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrXoPH7QRaaUNABjfpjkYuYjuc4YT0JGIT87HUhaS5B5EXLX9gs5SGdefatz8rk10ofLrDlfVl0DHS_o7l3BlYtbJjSH31X6xpm4OYuntjQCYXgO_XFh2HlouaxMKjcOnmFJvaHNJ-XXm3gC4mA2DpJBa428rLJJY3RCeZ4NRvaKM9I May 16 20:43:02.714562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:43:02.714562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:43:02.714562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:43:02.714562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:43:02.714562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:43:02.714562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:43:02.714562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:43:02.714562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:02.714562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:43:02.714562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:43:02.716175 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}] May 16 20:43:02.716175 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:02.716175 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:43:02.716175 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:02.716175 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:43:02.716175 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:43:02.716175 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:43:02.716175 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: b578680e88c741bda2c8e56b2dc9d335 May 16 20:43:02.716175 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:43:02.716175 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:43:02.716175 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 could not be found. May 16 20:43:02.716175 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': 'df423e7b-a5e3-4c9a-adbc-b64a2afd9752'} May 16 20:43:02.717043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:43:02.717043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:02.717043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:43:02.717043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:43:02.717043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:43:02.717043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:43:02.717043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:43:02.717043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:43:02.717043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:43:02.717043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:43:02.717043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 could not be found. May 16 20:43:02.717043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:02.717043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:02.717043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:02.717043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:02.717043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:02.717043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:02.717043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:43:02.717043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:43:02.717043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:43:02.718332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:43:02.718332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 20:43:02.718332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 20:43:02.718332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 20:43:02.718332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 20:43:02.718332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:43:02.718332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:43:02.718332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:43:02.718332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:43:02.718332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 could not be found. May 16 20:43:02.718332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:02.718332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:02.718332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:02.718332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:02.718332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:02.718332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:02.718332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:43:02.718332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:43:02.718332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 could not be found. May 16 20:43:02.718332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:02.719614 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-de574c06-6f02-4aab-81da-660475165044 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Returning 404 to user: Instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:43:02.719614 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-de574c06-6f02-4aab-81da-660475165044 tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "DELETE /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 404 len: 111 microversion: 2.1 time: 0.029544 May 16 20:43:02.719614 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 367/737] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:43:02 2022] DELETE /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:43:02.724596 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0826de9d-16ba-4322-a0fb-353e2f141e2b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:02.725217 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0826de9d-16ba-4322-a0fb-353e2f141e2b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] [instance: df423e7b-a5e3-4c9a-adbc-b64a2afd9752] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:02.731071 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0826de9d-16ba-4322-a0fb-353e2f141e2b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:02.731525 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0826de9d-16ba-4322-a0fb-353e2f141e2b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:02.732286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0826de9d-16ba-4322-a0fb-353e2f141e2b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:02.732747 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0826de9d-16ba-4322-a0fb-353e2f141e2b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:02.745730 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-0826de9d-16ba-4322-a0fb-353e2f141e2b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] HTTP exception thrown: Instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 could not be found. May 16 20:43:02.747226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0826de9d-16ba-4322-a0fb-353e2f141e2b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Request method failure captured: May 16 20:43:02.747226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 HTTP/1.1 May 16 20:43:02.747226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:43:02.747226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:43:02.747226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:43:02.747226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:43:02.747226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:43:02.747226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:43:02.747226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:43:02.747226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:43:02.747226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrXoPH7QRaaUNABjfpjkYuYjuc4YT0JGIT87HUhaS5B5EXLX9gs5SGdefatz8rk10ofLrDlfVl0DHS_o7l3BlYtbJjSH31X6xpm4OYuntjQCYXgO_XFh2HlouaxMKjcOnmFJvaHNJ-XXm3gC4mA2DpJBa428rLJJY3RCeZ4NRvaKM9I May 16 20:43:02.747226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:43:02.747226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:43:02.747226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:43:02.747226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:43:02.747226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:43:02.747226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:43:02.747226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:43:02.747226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:02.747226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:43:02.747226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:43:02.748838 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2beaab3a72a345d98a9ec4e0ae4686b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2beaab3a72a345d98a9ec4e0ae4686b6"}]}] May 16 20:43:02.748838 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:02.748838 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 2beaab3a72a345d98a9ec4e0ae4686b6 May 16 20:43:02.748838 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1167750620 May 16 20:43:02.748838 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:43:02.748838 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:43:02.748838 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:43:02.748838 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: b578680e88c741bda2c8e56b2dc9d335 May 16 20:43:02.748838 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-AttachVolumeNegativeTest-1167750620-project May 16 20:43:02.748838 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: > May 16 20:43:02.748838 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 could not be found. May 16 20:43:02.748838 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': 'df423e7b-a5e3-4c9a-adbc-b64a2afd9752'} May 16 20:43:02.749869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:43:02.749869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:02.749869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:43:02.749869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:43:02.749869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:43:02.749869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:43:02.749869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:43:02.749869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:43:02.749869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:43:02.749869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:43:02.749869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 could not be found. May 16 20:43:02.749869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:02.749869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:02.749869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:02.749869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:02.749869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:02.749869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:02.749869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:43:02.749869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:43:02.749869 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:43:02.751309 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:43:02.751309 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:43:02.751309 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:43:02.751309 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:43:02.751309 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:43:02.751309 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:43:02.751309 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:43:02.751309 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 could not be found. May 16 20:43:02.751309 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:02.751309 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:02.751309 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:02.751309 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:02.751309 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:02.751309 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:02.751309 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:43:02.751309 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:43:02.751309 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 could not be found. May 16 20:43:02.751309 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:02.752982 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0826de9d-16ba-4322-a0fb-353e2f141e2b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] Returning 404 to user: Instance df423e7b-a5e3-4c9a-adbc-b64a2afd9752 could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:43:02.752982 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0826de9d-16ba-4322-a0fb-353e2f141e2b tempest-AttachVolumeNegativeTest-1167750620 tempest-AttachVolumeNegativeTest-1167750620-project] 10.222.0.49 "GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752" status: 404 len: 111 microversion: 2.1 time: 0.027942 May 16 20:43:02.752982 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 371/738] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:02 2022] GET /compute/v2.1/servers/df423e7b-a5e3-4c9a-adbc-b64a2afd9752 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:43:03.091763 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-041c6246-60a3-43ed-91e9-1750a0bd8ac1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:03.092369 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-041c6246-60a3-43ed-91e9-1750a0bd8ac1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:03.100410 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-40cc8182-d0c7-42d2-b06d-64a2c5134d94 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:03.101043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-40cc8182-d0c7-42d2-b06d-64a2c5134d94 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:03.107943 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-041c6246-60a3-43ed-91e9-1750a0bd8ac1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:03.111586 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-40cc8182-d0c7-42d2-b06d-64a2c5134d94 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:03.112250 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-40cc8182-d0c7-42d2-b06d-64a2c5134d94 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:03.113179 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-40cc8182-d0c7-42d2-b06d-64a2c5134d94 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:03.113622 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-40cc8182-d0c7-42d2-b06d-64a2c5134d94 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:03.116608 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-041c6246-60a3-43ed-91e9-1750a0bd8ac1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:03.117454 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-041c6246-60a3-43ed-91e9-1750a0bd8ac1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:03.117894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-041c6246-60a3-43ed-91e9-1750a0bd8ac1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:03.335060 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-40cc8182-d0c7-42d2-b06d-64a2c5134d94 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:03.338801 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-041c6246-60a3-43ed-91e9-1750a0bd8ac1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:03.343660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-40cc8182-d0c7-42d2-b06d-64a2c5134d94 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:03.345494 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-40cc8182-d0c7-42d2-b06d-64a2c5134d94 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:03.346688 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-041c6246-60a3-43ed-91e9-1750a0bd8ac1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1266 microversion: 2.1 time: 0.259046 May 16 20:43:03.346992 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-40cc8182-d0c7-42d2-b06d-64a2c5134d94 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1730 microversion: 2.20 time: 0.250414 May 16 20:43:03.347263 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 368/739] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:03 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:03.347894 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 372/740] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:43:03 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1730 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:43:04.363093 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-3401f10b-6b27-49c2-a307-3a54ecb1ef3a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:04.363628 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-3401f10b-6b27-49c2-a307-3a54ecb1ef3a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:04.365002 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-dfdebf21-952a-4ade-b78c-faf7884282d8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:04.366707 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-dfdebf21-952a-4ade-b78c-faf7884282d8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:04.371094 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3401f10b-6b27-49c2-a307-3a54ecb1ef3a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:04.371550 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3401f10b-6b27-49c2-a307-3a54ecb1ef3a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:04.372311 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3401f10b-6b27-49c2-a307-3a54ecb1ef3a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:04.372763 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3401f10b-6b27-49c2-a307-3a54ecb1ef3a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:04.373389 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dfdebf21-952a-4ade-b78c-faf7884282d8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:04.373840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dfdebf21-952a-4ade-b78c-faf7884282d8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:04.374627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dfdebf21-952a-4ade-b78c-faf7884282d8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:04.375068 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dfdebf21-952a-4ade-b78c-faf7884282d8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:04.563682 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3401f10b-6b27-49c2-a307-3a54ecb1ef3a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:04.574532 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-3401f10b-6b27-49c2-a307-3a54ecb1ef3a tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1266 microversion: 2.1 time: 0.215447 May 16 20:43:04.575128 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 369/741] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:04 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:04.617684 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-dfdebf21-952a-4ade-b78c-faf7884282d8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:04.626634 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-dfdebf21-952a-4ade-b78c-faf7884282d8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:04.628499 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-dfdebf21-952a-4ade-b78c-faf7884282d8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:04.629900 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-dfdebf21-952a-4ade-b78c-faf7884282d8 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1717 microversion: 2.20 time: 0.268964 May 16 20:43:04.643010 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 373/742] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:43:04 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1717 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:43:05.591282 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-3f7310a4-c468-4cef-a95c-8e67270d3147 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:05.591897 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-3f7310a4-c468-4cef-a95c-8e67270d3147 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:05.608093 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3f7310a4-c468-4cef-a95c-8e67270d3147 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:05.608603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3f7310a4-c468-4cef-a95c-8e67270d3147 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:05.609392 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3f7310a4-c468-4cef-a95c-8e67270d3147 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:05.609825 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3f7310a4-c468-4cef-a95c-8e67270d3147 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:05.844883 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3f7310a4-c468-4cef-a95c-8e67270d3147 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:05.853207 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-3f7310a4-c468-4cef-a95c-8e67270d3147 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1266 microversion: 2.1 time: 0.265792 May 16 20:43:05.853870 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 370/743] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:05 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:06.686446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-f1fc7d88-816a-4139-b219-ad89a1f33fa1 req-a97db239-6c5f-4a51-851b-0451a6d20359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0412e9-a238-47bb-8e08-de4a723b74f1", "name": "network-vif-plugged", "status": "completed", "tag": "38516439-bbc9-4e23-9ca0-a93ad3f94ec1"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:43:06.699774 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-f1fc7d88-816a-4139-b219-ad89a1f33fa1 req-a97db239-6c5f-4a51-851b-0451a6d20359 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:06.700577 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-f1fc7d88-816a-4139-b219-ad89a1f33fa1 req-a97db239-6c5f-4a51-851b-0451a6d20359 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:06.719619 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-f1fc7d88-816a-4139-b219-ad89a1f33fa1 req-a97db239-6c5f-4a51-851b-0451a6d20359 service nova] Creating event network-vif-plugged:38516439-bbc9-4e23-9ca0-a93ad3f94ec1 for instance 0e0412e9-a238-47bb-8e08-de4a723b74f1 on hv-cinder-77703 May 16 20:43:06.726839 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-f1fc7d88-816a-4139-b219-ad89a1f33fa1 req-a97db239-6c5f-4a51-851b-0451a6d20359 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044263 May 16 20:43:06.728011 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 374/744] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:43:06.870994 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-b35e9987-14fa-4a68-aa39-707c1280eca1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:06.871618 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-b35e9987-14fa-4a68-aa39-707c1280eca1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:06.885971 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b35e9987-14fa-4a68-aa39-707c1280eca1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:06.886472 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b35e9987-14fa-4a68-aa39-707c1280eca1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:06.887834 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b35e9987-14fa-4a68-aa39-707c1280eca1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:06.888280 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b35e9987-14fa-4a68-aa39-707c1280eca1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:07.120883 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-b35e9987-14fa-4a68-aa39-707c1280eca1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:07.129270 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-b35e9987-14fa-4a68-aa39-707c1280eca1 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1266 microversion: 2.1 time: 0.262091 May 16 20:43:07.139405 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 371/745] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:06 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:08.146275 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-788bf078-0f63-4d2e-a3b7-95a2a13b2e38 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:08.146950 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-788bf078-0f63-4d2e-a3b7-95a2a13b2e38 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:08.153629 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-788bf078-0f63-4d2e-a3b7-95a2a13b2e38 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:08.154259 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-788bf078-0f63-4d2e-a3b7-95a2a13b2e38 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:08.154851 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-788bf078-0f63-4d2e-a3b7-95a2a13b2e38 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:08.155286 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-788bf078-0f63-4d2e-a3b7-95a2a13b2e38 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:08.287577 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-788bf078-0f63-4d2e-a3b7-95a2a13b2e38 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:08.295456 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-788bf078-0f63-4d2e-a3b7-95a2a13b2e38 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1266 microversion: 2.1 time: 0.153391 May 16 20:43:08.296049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 375/746] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:08 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:09.260581 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-13d8d046-4b3a-4c24-99c8-2d6015dd675c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1896819210", "imageRef": "f9826e12-1d0c-4a5a-9616-338520403016", "flavorRef": "452"}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:43:09.312808 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.network.neutron [None req-13d8d046-4b3a-4c24-99c8-2d6015dd675c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] validate_networks() for None {{(pid=123564) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:43:09.313222 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7e652336-6c64-4886-adbc-072205f7d92e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:09.313840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-7e652336-6c64-4886-adbc-072205f7d92e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:09.320906 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7e652336-6c64-4886-adbc-072205f7d92e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:09.321387 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7e652336-6c64-4886-adbc-072205f7d92e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:09.322123 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7e652336-6c64-4886-adbc-072205f7d92e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:09.322559 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7e652336-6c64-4886-adbc-072205f7d92e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:09.610992 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-7e652336-6c64-4886-adbc-072205f7d92e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:09.619312 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-7e652336-6c64-4886-adbc-072205f7d92e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1454 microversion: 2.1 time: 0.310165 May 16 20:43:09.619733 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 376/747] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:09 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1454 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:09.639919 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-784affcd-6f16-4033-ac7b-d50edc1fad65 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:09.640577 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-784affcd-6f16-4033-ac7b-d50edc1fad65 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:09.646632 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-784affcd-6f16-4033-ac7b-d50edc1fad65 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:09.647080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-784affcd-6f16-4033-ac7b-d50edc1fad65 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:09.647868 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-784affcd-6f16-4033-ac7b-d50edc1fad65 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:09.648289 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-784affcd-6f16-4033-ac7b-d50edc1fad65 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:09.658307 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-13d8d046-4b3a-4c24-99c8-2d6015dd675c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Flavor limits 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:43:09.658717 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-13d8d046-4b3a-4c24-99c8-2d6015dd675c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Image limits 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:43:09.659186 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-13d8d046-4b3a-4c24-99c8-2d6015dd675c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Flavor pref 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:43:09.660081 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-13d8d046-4b3a-4c24-99c8-2d6015dd675c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Image pref 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:43:09.660081 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-13d8d046-4b3a-4c24-99c8-2d6015dd675c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:43:09.670115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-13d8d046-4b3a-4c24-99c8-2d6015dd675c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:09.670562 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-13d8d046-4b3a-4c24-99c8-2d6015dd675c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:09.671345 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-13d8d046-4b3a-4c24-99c8-2d6015dd675c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:09.671786 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-13d8d046-4b3a-4c24-99c8-2d6015dd675c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:09.694757 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-13d8d046-4b3a-4c24-99c8-2d6015dd675c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Getting quotas for project 6bbb756cc7a349b1a8eae1b170f600aa. Resources: {'cores', 'ram', 'instances'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:43:09.699209 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-13d8d046-4b3a-4c24-99c8-2d6015dd675c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Getting quotas for user fdb9cf003d1b4fb7b053ab43739d5b87 and project 6bbb756cc7a349b1a8eae1b170f600aa. Resources: {'cores', 'ram', 'instances'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:43:09.717435 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-13d8d046-4b3a-4c24-99c8-2d6015dd675c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Going to run 1 instances... {{(pid=123564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:43:09.717435 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-13d8d046-4b3a-4c24-99c8-2d6015dd675c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] [instance: 7803d8fa-3c19-43dd-a1d9-771353159e25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9826e12-1d0c-4a5a-9616-338520403016',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:43:09.765671 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-13d8d046-4b3a-4c24-99c8-2d6015dd675c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509208 May 16 20:43:09.766776 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 372/748] 10.222.0.49 () {60 vars in 1146 bytes} [Mon May 16 20:43:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 20:43:09.776504 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e89eef37-e206-4494-a3f7-d0caab435730 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:09.777110 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-e89eef37-e206-4494-a3f7-d0caab435730 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] [instance: 7803d8fa-3c19-43dd-a1d9-771353159e25] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:09.806179 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-784affcd-6f16-4033-ac7b-d50edc1fad65 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:09.815221 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-784affcd-6f16-4033-ac7b-d50edc1fad65 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1454 microversion: 2.1 time: 0.183842 May 16 20:43:09.817622 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 377/749] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:09 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1454 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:09.840512 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e89eef37-e206-4494-a3f7-d0caab435730 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb9cf003d1b4fb7b053ab43739d5b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbb756cc7a349b1a8eae1b170f600aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:09.848587 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-e89eef37-e206-4494-a3f7-d0caab435730 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] 10.222.0.49 "GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25" status: 200 len: 1215 microversion: 2.1 time: 0.075799 May 16 20:43:09.849378 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 373/750] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:09 2022] GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25 => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:43:10.871777 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-d99352f8-2519-4077-a5e3-c3a6d8123bb6 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:10.874137 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-d99352f8-2519-4077-a5e3-c3a6d8123bb6 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] [instance: 7803d8fa-3c19-43dd-a1d9-771353159e25] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:10.885267 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d99352f8-2519-4077-a5e3-c3a6d8123bb6 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:10.886044 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d99352f8-2519-4077-a5e3-c3a6d8123bb6 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:10.887943 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d99352f8-2519-4077-a5e3-c3a6d8123bb6 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:10.888928 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d99352f8-2519-4077-a5e3-c3a6d8123bb6 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:10.979393 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d99352f8-2519-4077-a5e3-c3a6d8123bb6 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb9cf003d1b4fb7b053ab43739d5b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbb756cc7a349b1a8eae1b170f600aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:10.989444 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-d99352f8-2519-4077-a5e3-c3a6d8123bb6 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] 10.222.0.49 "GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25" status: 200 len: 1273 microversion: 2.1 time: 0.123073 May 16 20:43:11.000258 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 378/751] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:10 2022] GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25 => generated 1273 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:11.513554 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-67b6c312-c0ae-4342-828c-770cac6b6ec7 req-eacf3771-5d6c-43ce-a502-a3125f72bec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e0412e9-a238-47bb-8e08-de4a723b74f1", "tag": "38516439-bbc9-4e23-9ca0-a93ad3f94ec1"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:43:11.525680 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-67b6c312-c0ae-4342-828c-770cac6b6ec7 req-eacf3771-5d6c-43ce-a502-a3125f72bec3 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:11.526479 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-67b6c312-c0ae-4342-828c-770cac6b6ec7 req-eacf3771-5d6c-43ce-a502-a3125f72bec3 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:11.537620 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-67b6c312-c0ae-4342-828c-770cac6b6ec7 req-eacf3771-5d6c-43ce-a502-a3125f72bec3 service nova] Creating event network-changed:38516439-bbc9-4e23-9ca0-a93ad3f94ec1 for instance 0e0412e9-a238-47bb-8e08-de4a723b74f1 on hv-cinder-77703 May 16 20:43:11.543160 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-67b6c312-c0ae-4342-828c-770cac6b6ec7 req-eacf3771-5d6c-43ce-a502-a3125f72bec3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033253 May 16 20:43:11.544016 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 374/752] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:43:12.007176 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-39517f7f-da20-412b-987c-b3cb7be5c55c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:12.007806 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-39517f7f-da20-412b-987c-b3cb7be5c55c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] [instance: 7803d8fa-3c19-43dd-a1d9-771353159e25] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:12.023107 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-39517f7f-da20-412b-987c-b3cb7be5c55c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:12.023961 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-39517f7f-da20-412b-987c-b3cb7be5c55c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:12.025291 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-39517f7f-da20-412b-987c-b3cb7be5c55c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:12.026085 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-39517f7f-da20-412b-987c-b3cb7be5c55c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:12.548580 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-39517f7f-da20-412b-987c-b3cb7be5c55c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb9cf003d1b4fb7b053ab43739d5b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbb756cc7a349b1a8eae1b170f600aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:12.562371 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-39517f7f-da20-412b-987c-b3cb7be5c55c tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] 10.222.0.49 "GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25" status: 200 len: 1315 microversion: 2.1 time: 0.558813 May 16 20:43:12.563674 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 379/753] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:12 2022] GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25 => generated 1315 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:13.114267 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-06d24b57-8440-468a-9197-a7113c162baa req-28b25753-4ad4-4166-8760-62426d505f52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7803d8fa-3c19-43dd-a1d9-771353159e25", "tag": "8578071a-f9a4-44fd-b946-38db426b54f8"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:43:13.131628 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-06d24b57-8440-468a-9197-a7113c162baa req-28b25753-4ad4-4166-8760-62426d505f52 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:13.132036 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-06d24b57-8440-468a-9197-a7113c162baa req-28b25753-4ad4-4166-8760-62426d505f52 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:13.144685 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-06d24b57-8440-468a-9197-a7113c162baa req-28b25753-4ad4-4166-8760-62426d505f52 service nova] Creating event network-changed:8578071a-f9a4-44fd-b946-38db426b54f8 for instance 7803d8fa-3c19-43dd-a1d9-771353159e25 on hv-cinder-77703 May 16 20:43:13.150681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-06d24b57-8440-468a-9197-a7113c162baa req-28b25753-4ad4-4166-8760-62426d505f52 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041087 May 16 20:43:13.151899 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 375/754] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:43:13.579397 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-382ddc6f-4c54-4b7e-bf4d-d703f036d002 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:13.579997 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-382ddc6f-4c54-4b7e-bf4d-d703f036d002 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] [instance: 7803d8fa-3c19-43dd-a1d9-771353159e25] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:13.586659 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-382ddc6f-4c54-4b7e-bf4d-d703f036d002 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:13.587336 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-382ddc6f-4c54-4b7e-bf4d-d703f036d002 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:13.588107 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-382ddc6f-4c54-4b7e-bf4d-d703f036d002 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:13.588538 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-382ddc6f-4c54-4b7e-bf4d-d703f036d002 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:13.722618 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-382ddc6f-4c54-4b7e-bf4d-d703f036d002 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb9cf003d1b4fb7b053ab43739d5b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbb756cc7a349b1a8eae1b170f600aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:13.730251 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-382ddc6f-4c54-4b7e-bf4d-d703f036d002 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] 10.222.0.49 "GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25" status: 200 len: 1315 microversion: 2.1 time: 0.154967 May 16 20:43:13.730847 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 380/755] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:13 2022] GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:14.748374 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-66a04d36-ead8-44e0-bb9b-d69423619d2d tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:14.750433 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-66a04d36-ead8-44e0-bb9b-d69423619d2d tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] [instance: 7803d8fa-3c19-43dd-a1d9-771353159e25] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:14.758207 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-66a04d36-ead8-44e0-bb9b-d69423619d2d tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:14.758650 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-66a04d36-ead8-44e0-bb9b-d69423619d2d tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:14.759424 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-66a04d36-ead8-44e0-bb9b-d69423619d2d tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:14.759850 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-66a04d36-ead8-44e0-bb9b-d69423619d2d tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:14.929841 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-66a04d36-ead8-44e0-bb9b-d69423619d2d tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb9cf003d1b4fb7b053ab43739d5b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbb756cc7a349b1a8eae1b170f600aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:14.938913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-66a04d36-ead8-44e0-bb9b-d69423619d2d tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] 10.222.0.49 "GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25" status: 200 len: 1315 microversion: 2.1 time: 0.195547 May 16 20:43:14.939637 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 376/756] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:14 2022] GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:15.956407 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0109b7ea-895d-4b0c-89c4-3ef9b8cc0d99 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:15.957136 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0109b7ea-895d-4b0c-89c4-3ef9b8cc0d99 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] [instance: 7803d8fa-3c19-43dd-a1d9-771353159e25] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:15.964145 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0109b7ea-895d-4b0c-89c4-3ef9b8cc0d99 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:15.964611 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0109b7ea-895d-4b0c-89c4-3ef9b8cc0d99 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:15.965380 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0109b7ea-895d-4b0c-89c4-3ef9b8cc0d99 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:15.965809 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0109b7ea-895d-4b0c-89c4-3ef9b8cc0d99 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:16.093475 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-0109b7ea-895d-4b0c-89c4-3ef9b8cc0d99 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb9cf003d1b4fb7b053ab43739d5b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbb756cc7a349b1a8eae1b170f600aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:16.100691 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0109b7ea-895d-4b0c-89c4-3ef9b8cc0d99 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] 10.222.0.49 "GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25" status: 200 len: 1315 microversion: 2.1 time: 0.148304 May 16 20:43:16.101269 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 381/757] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:15 2022] GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:17.116894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-d0cea133-3dc4-4157-8602-467247634d55 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:17.117518 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-d0cea133-3dc4-4157-8602-467247634d55 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] [instance: 7803d8fa-3c19-43dd-a1d9-771353159e25] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:17.123387 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d0cea133-3dc4-4157-8602-467247634d55 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:17.123833 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d0cea133-3dc4-4157-8602-467247634d55 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:17.124630 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d0cea133-3dc4-4157-8602-467247634d55 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:17.125059 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d0cea133-3dc4-4157-8602-467247634d55 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:17.258886 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-d0cea133-3dc4-4157-8602-467247634d55 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb9cf003d1b4fb7b053ab43739d5b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbb756cc7a349b1a8eae1b170f600aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:17.266129 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-d0cea133-3dc4-4157-8602-467247634d55 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] 10.222.0.49 "GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25" status: 200 len: 1315 microversion: 2.1 time: 0.153276 May 16 20:43:17.266714 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 377/758] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:17 2022] GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:18.284073 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-3f067883-f1ed-4405-b5af-39c726573c74 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:18.284723 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-3f067883-f1ed-4405-b5af-39c726573c74 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] [instance: 7803d8fa-3c19-43dd-a1d9-771353159e25] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:18.292649 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3f067883-f1ed-4405-b5af-39c726573c74 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:18.293194 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3f067883-f1ed-4405-b5af-39c726573c74 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:18.294116 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3f067883-f1ed-4405-b5af-39c726573c74 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:18.294666 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3f067883-f1ed-4405-b5af-39c726573c74 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:18.430683 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-3f067883-f1ed-4405-b5af-39c726573c74 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb9cf003d1b4fb7b053ab43739d5b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbb756cc7a349b1a8eae1b170f600aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:18.439071 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-3f067883-f1ed-4405-b5af-39c726573c74 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] 10.222.0.49 "GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25" status: 200 len: 1315 microversion: 2.1 time: 0.159248 May 16 20:43:18.439733 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 382/759] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:18 2022] GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:18.672363 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-c3008e34-ca0e-4ad4-b3d7-89be1fbefd30 req-b71e1093-b76a-42e4-9a17-84a6c7819d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7803d8fa-3c19-43dd-a1d9-771353159e25", "name": "network-vif-plugged", "status": "completed", "tag": "8578071a-f9a4-44fd-b946-38db426b54f8"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:43:18.681289 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-c3008e34-ca0e-4ad4-b3d7-89be1fbefd30 req-b71e1093-b76a-42e4-9a17-84a6c7819d29 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:18.681701 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-c3008e34-ca0e-4ad4-b3d7-89be1fbefd30 req-b71e1093-b76a-42e4-9a17-84a6c7819d29 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:18.693908 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-c3008e34-ca0e-4ad4-b3d7-89be1fbefd30 req-b71e1093-b76a-42e4-9a17-84a6c7819d29 service nova] Creating event network-vif-plugged:8578071a-f9a4-44fd-b946-38db426b54f8 for instance 7803d8fa-3c19-43dd-a1d9-771353159e25 on hv-cinder-77703 May 16 20:43:18.698902 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-c3008e34-ca0e-4ad4-b3d7-89be1fbefd30 req-b71e1093-b76a-42e4-9a17-84a6c7819d29 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030506 May 16 20:43:18.699704 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 378/760] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:43:19.458457 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-4127d7ed-8546-402a-a790-dedd7d39c2a7 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:19.459048 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-4127d7ed-8546-402a-a790-dedd7d39c2a7 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] [instance: 7803d8fa-3c19-43dd-a1d9-771353159e25] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:19.466252 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4127d7ed-8546-402a-a790-dedd7d39c2a7 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:19.466710 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4127d7ed-8546-402a-a790-dedd7d39c2a7 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:19.467500 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4127d7ed-8546-402a-a790-dedd7d39c2a7 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:19.467948 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4127d7ed-8546-402a-a790-dedd7d39c2a7 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:19.606644 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-4127d7ed-8546-402a-a790-dedd7d39c2a7 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb9cf003d1b4fb7b053ab43739d5b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbb756cc7a349b1a8eae1b170f600aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:19.617620 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-4127d7ed-8546-402a-a790-dedd7d39c2a7 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] 10.222.0.49 "GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25" status: 200 len: 1315 microversion: 2.1 time: 0.164072 May 16 20:43:19.618399 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 383/761] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:19 2022] GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:20.639752 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-b0619adf-c76b-4747-addc-fcd73d33660d tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:20.640352 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-b0619adf-c76b-4747-addc-fcd73d33660d tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] [instance: 7803d8fa-3c19-43dd-a1d9-771353159e25] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:20.647243 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b0619adf-c76b-4747-addc-fcd73d33660d tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:20.647717 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b0619adf-c76b-4747-addc-fcd73d33660d tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:20.648566 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b0619adf-c76b-4747-addc-fcd73d33660d tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:20.649034 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b0619adf-c76b-4747-addc-fcd73d33660d tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:20.780595 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-b0619adf-c76b-4747-addc-fcd73d33660d tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb9cf003d1b4fb7b053ab43739d5b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbb756cc7a349b1a8eae1b170f600aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:20.788153 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-b0619adf-c76b-4747-addc-fcd73d33660d tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] 10.222.0.49 "GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25" status: 200 len: 1465 microversion: 2.1 time: 0.153400 May 16 20:43:20.788728 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 379/762] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:20 2022] GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25 => generated 1465 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:20.828927 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-c20cb84f-d4ed-4c32-9203-d8769c224d86 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:20.829518 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-c20cb84f-d4ed-4c32-9203-d8769c224d86 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] [instance: 7803d8fa-3c19-43dd-a1d9-771353159e25] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:20.836804 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c20cb84f-d4ed-4c32-9203-d8769c224d86 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:20.837256 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c20cb84f-d4ed-4c32-9203-d8769c224d86 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:20.838026 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c20cb84f-d4ed-4c32-9203-d8769c224d86 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:20.838464 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c20cb84f-d4ed-4c32-9203-d8769c224d86 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:20.863612 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-c20cb84f-d4ed-4c32-9203-d8769c224d86 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] [instance: 7803d8fa-3c19-43dd-a1d9-771353159e25] Going to try to terminate instance {{(pid=123563) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:43:20.953146 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-c20cb84f-d4ed-4c32-9203-d8769c224d86 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25" status: 204 len: 0 microversion: 2.1 time: 0.127923 May 16 20:43:20.953744 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 384/763] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:43:20 2022] DELETE /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 20:43:20.962036 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-de6149b5-3d47-4e7b-8f03-c4e840464afc tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:20.962644 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-de6149b5-3d47-4e7b-8f03-c4e840464afc tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] [instance: 7803d8fa-3c19-43dd-a1d9-771353159e25] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:20.969415 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-de6149b5-3d47-4e7b-8f03-c4e840464afc tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:20.969718 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-de6149b5-3d47-4e7b-8f03-c4e840464afc tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:20.970493 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-de6149b5-3d47-4e7b-8f03-c4e840464afc tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:20.970918 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-de6149b5-3d47-4e7b-8f03-c4e840464afc tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:21.112499 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-de6149b5-3d47-4e7b-8f03-c4e840464afc tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb9cf003d1b4fb7b053ab43739d5b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbb756cc7a349b1a8eae1b170f600aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:21.120418 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-de6149b5-3d47-4e7b-8f03-c4e840464afc tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] 10.222.0.49 "GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25" status: 200 len: 1471 microversion: 2.1 time: 0.162335 May 16 20:43:21.121151 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 380/764] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:20 2022] GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25 => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:22.138354 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-d2996498-398a-45ee-9187-803e01714442 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:22.139076 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-d2996498-398a-45ee-9187-803e01714442 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] [instance: 7803d8fa-3c19-43dd-a1d9-771353159e25] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:22.145530 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d2996498-398a-45ee-9187-803e01714442 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:22.145973 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d2996498-398a-45ee-9187-803e01714442 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:22.146837 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d2996498-398a-45ee-9187-803e01714442 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:22.147295 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d2996498-398a-45ee-9187-803e01714442 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:22.279176 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d2996498-398a-45ee-9187-803e01714442 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb9cf003d1b4fb7b053ab43739d5b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbb756cc7a349b1a8eae1b170f600aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:22.286776 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-d2996498-398a-45ee-9187-803e01714442 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] 10.222.0.49 "GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25" status: 200 len: 1471 microversion: 2.1 time: 0.152660 May 16 20:43:22.287333 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 385/765] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:22 2022] GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25 => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:23.036544 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-e3129135-3cbe-4f04-a98e-8f299f7c880a req-7c47755d-5a2d-4e3d-9c3d-8b07ab63e915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7803d8fa-3c19-43dd-a1d9-771353159e25", "name": "network-vif-deleted", "tag": "8578071a-f9a4-44fd-b946-38db426b54f8"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:43:23.047281 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-e3129135-3cbe-4f04-a98e-8f299f7c880a req-7c47755d-5a2d-4e3d-9c3d-8b07ab63e915 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:23.047799 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-e3129135-3cbe-4f04-a98e-8f299f7c880a req-7c47755d-5a2d-4e3d-9c3d-8b07ab63e915 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:23.061306 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-e3129135-3cbe-4f04-a98e-8f299f7c880a req-7c47755d-5a2d-4e3d-9c3d-8b07ab63e915 service nova] Creating event network-vif-deleted:8578071a-f9a4-44fd-b946-38db426b54f8 for instance 7803d8fa-3c19-43dd-a1d9-771353159e25 on hv-cinder-77703 May 16 20:43:23.066448 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-e3129135-3cbe-4f04-a98e-8f299f7c880a req-7c47755d-5a2d-4e3d-9c3d-8b07ab63e915 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033602 May 16 20:43:23.067072 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 381/766] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:43:23.303546 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7621c603-d45b-4860-9dae-90476b48af56 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:23.304099 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-7621c603-d45b-4860-9dae-90476b48af56 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] [instance: 7803d8fa-3c19-43dd-a1d9-771353159e25] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:23.311305 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7621c603-d45b-4860-9dae-90476b48af56 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:23.311760 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7621c603-d45b-4860-9dae-90476b48af56 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:23.312540 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7621c603-d45b-4860-9dae-90476b48af56 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:23.313008 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7621c603-d45b-4860-9dae-90476b48af56 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:23.352363 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7621c603-d45b-4860-9dae-90476b48af56 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:23.352945 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7621c603-d45b-4860-9dae-90476b48af56 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:23.353435 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.objects.instance [None req-7621c603-d45b-4860-9dae-90476b48af56 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lazy-loading 'fault' on Instance uuid 7803d8fa-3c19-43dd-a1d9-771353159e25 {{(pid=123563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:43:23.395541 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-7621c603-d45b-4860-9dae-90476b48af56 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb9cf003d1b4fb7b053ab43739d5b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbb756cc7a349b1a8eae1b170f600aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:23.403422 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-7621c603-d45b-4860-9dae-90476b48af56 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] 10.222.0.49 "GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25" status: 200 len: 1305 microversion: 2.1 time: 0.103951 May 16 20:43:23.404030 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 386/767] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:23 2022] GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25 => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:24.422144 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-f665481c-9382-4ab3-a9b3-9444bcf92257 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:24.422843 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-f665481c-9382-4ab3-a9b3-9444bcf92257 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] [instance: 7803d8fa-3c19-43dd-a1d9-771353159e25] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:24.430189 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f665481c-9382-4ab3-a9b3-9444bcf92257 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:24.430647 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f665481c-9382-4ab3-a9b3-9444bcf92257 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:24.431438 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f665481c-9382-4ab3-a9b3-9444bcf92257 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:24.431878 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f665481c-9382-4ab3-a9b3-9444bcf92257 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:24.446565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-f665481c-9382-4ab3-a9b3-9444bcf92257 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] HTTP exception thrown: Instance 7803d8fa-3c19-43dd-a1d9-771353159e25 could not be found. May 16 20:43:24.448184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-f665481c-9382-4ab3-a9b3-9444bcf92257 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Request method failure captured: May 16 20:43:24.448184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25 HTTP/1.1 May 16 20:43:24.448184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:43:24.448184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:43:24.448184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:43:24.448184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:43:24.448184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:43:24.448184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:43:24.448184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:43:24.448184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:43:24.448184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrdbH74hXT5isc7Cmt3qM0AaFaPBUkZNVfI7QrMI5SRDMpUeoNR4XF8E8vxlRIciTf9hUlKDVH5HCzWGeszV_aHDDT9jChhmhPCEE8hs1BSxlIRdG1RFCNqEIDJqmff99mqAjsSLlLbfOr7x8co3YVxvPcuVMhe0IaOeScz-t92CSXo May 16 20:43:24.448184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:43:24.448184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:43:24.448184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:43:24.448184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:43:24.448184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:43:24.448184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:43:24.448184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 6bbb756cc7a349b1a8eae1b170f600aa May 16 20:43:24.448184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-VolumesNegativeTest-672890461 May 16 20:43:24.448184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:43:24.448184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:43:24.449881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6bbb756cc7a349b1a8eae1b170f600aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6bbb756cc7a349b1a8eae1b170f600aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6bbb756cc7a349b1a8eae1b170f600aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6bbb756cc7a349b1a8eae1b170f600aa"}]}] May 16 20:43:24.449881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-VolumesNegativeTest-672890461 May 16 20:43:24.449881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 6bbb756cc7a349b1a8eae1b170f600aa May 16 20:43:24.449881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-VolumesNegativeTest-672890461 May 16 20:43:24.449881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-VolumesNegativeTest-672890461-project May 16 20:43:24.449881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:43:24.449881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:43:24.449881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: fdb9cf003d1b4fb7b053ab43739d5b87 May 16 20:43:24.449881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-VolumesNegativeTest-672890461-project May 16 20:43:24.449881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:43:24.449881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance 7803d8fa-3c19-43dd-a1d9-771353159e25 could not be found. May 16 20:43:24.449881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': '7803d8fa-3c19-43dd-a1d9-771353159e25'} May 16 20:43:24.450881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:43:24.450881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:24.450881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:43:24.450881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:43:24.450881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:43:24.450881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:43:24.450881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:43:24.450881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:43:24.450881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:43:24.450881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:43:24.450881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7803d8fa-3c19-43dd-a1d9-771353159e25 could not be found. May 16 20:43:24.450881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:24.450881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:24.450881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:24.450881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:24.450881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:24.450881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:24.450881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:43:24.450881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:43:24.450881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:43:24.452266 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:43:24.452266 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:43:24.452266 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:43:24.452266 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:43:24.452266 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:43:24.452266 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:43:24.452266 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:43:24.452266 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7803d8fa-3c19-43dd-a1d9-771353159e25 could not be found. May 16 20:43:24.452266 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:24.452266 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:24.452266 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:24.452266 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:24.452266 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:24.452266 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:24.452266 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:43:24.452266 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:43:24.452266 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7803d8fa-3c19-43dd-a1d9-771353159e25 could not be found. May 16 20:43:24.452266 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:24.453457 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-f665481c-9382-4ab3-a9b3-9444bcf92257 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] Returning 404 to user: Instance 7803d8fa-3c19-43dd-a1d9-771353159e25 could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:43:24.453457 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-f665481c-9382-4ab3-a9b3-9444bcf92257 tempest-VolumesNegativeTest-672890461 tempest-VolumesNegativeTest-672890461-project] 10.222.0.49 "GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25" status: 404 len: 111 microversion: 2.1 time: 0.032266 May 16 20:43:24.453457 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 382/768] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:24 2022] GET /compute/v2.1/servers/7803d8fa-3c19-43dd-a1d9-771353159e25 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:43:39.355651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7cbc2c31-b6c9-49a3-99f4-c93cfa33e8f2 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Action: 'create', calling method: .version_select at 0x7f81b10e3040>, body: {"keypair": {"name": "tempest-TestShelveInstance-532846035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlzGh14trcBzwDNO3DkALbzKgHFqf2XQbJqwD3ky1jBXORE8VUTvmtQs4Vt7GFs+QFY3ijdEyJ0LZjxsROk1sf7fnNUzUd9koSsPLCaJpA1VRLYzf2i3pfavynX6FDp6g=="}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:43:39.382435 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-7cbc2c31-b6c9-49a3-99f4-c93cfa33e8f2 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Getting quotas for project eb89e1020d944ea08b4294be0ac00cbf. Resources: {'key_pairs'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:43:39.386726 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-7cbc2c31-b6c9-49a3-99f4-c93cfa33e8f2 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Getting quotas for user 7efe317417084146a0ff20116ed48cbb and project eb89e1020d944ea08b4294be0ac00cbf. Resources: {'key_pairs'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:43:39.419318 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-7cbc2c31-b6c9-49a3-99f4-c93cfa33e8f2 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.266386 May 16 20:43:39.420766 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 387/769] 10.222.0.49 () {60 vars in 1158 bytes} [Mon May 16 20:43:39 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:43:43.056474 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a4420288-c4b7-4eb7-afa8-ee7555b41a56 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:43.057526 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-a4420288-c4b7-4eb7-afa8-ee7555b41a56 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:43.064460 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a4420288-c4b7-4eb7-afa8-ee7555b41a56 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:43.064908 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a4420288-c4b7-4eb7-afa8-ee7555b41a56 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:43.065699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a4420288-c4b7-4eb7-afa8-ee7555b41a56 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:43.066130 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a4420288-c4b7-4eb7-afa8-ee7555b41a56 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:43.098454 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-a4420288-c4b7-4eb7-afa8-ee7555b41a56 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046047 May 16 20:43:43.099645 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 383/770] 10.222.0.49 () {60 vars in 1342 bytes} [Mon May 16 20:43:43 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:43.185473 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-eaf72622-6675-4e38-b5fa-f60af9d19aeb tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:43.186037 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-eaf72622-6675-4e38-b5fa-f60af9d19aeb tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:43.194142 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-eaf72622-6675-4e38-b5fa-f60af9d19aeb tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:43.194604 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-eaf72622-6675-4e38-b5fa-f60af9d19aeb tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:43.197136 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-eaf72622-6675-4e38-b5fa-f60af9d19aeb tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:43.197661 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-eaf72622-6675-4e38-b5fa-f60af9d19aeb tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:43.226263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-eaf72622-6675-4e38-b5fa-f60af9d19aeb tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Going to try to terminate instance {{(pid=123563) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:43:43.312202 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-eaf72622-6675-4e38-b5fa-f60af9d19aeb tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 204 len: 0 microversion: 2.20 time: 0.134553 May 16 20:43:43.313387 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 388/771] 10.222.0.49 () {60 vars in 1279 bytes} [Mon May 16 20:43:43 2022] DELETE /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 16 20:43:43.321897 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-823f139f-25dd-4241-89d5-b716c8af4e03 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:43.322508 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-823f139f-25dd-4241-89d5-b716c8af4e03 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:43.331117 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-823f139f-25dd-4241-89d5-b716c8af4e03 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:43.331567 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-823f139f-25dd-4241-89d5-b716c8af4e03 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:43.332359 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-823f139f-25dd-4241-89d5-b716c8af4e03 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:43.332838 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-823f139f-25dd-4241-89d5-b716c8af4e03 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:43.483537 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-823f139f-25dd-4241-89d5-b716c8af4e03 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:43.494985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-823f139f-25dd-4241-89d5-b716c8af4e03 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:43.496628 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-823f139f-25dd-4241-89d5-b716c8af4e03 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:43.498345 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-823f139f-25dd-4241-89d5-b716c8af4e03 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1723 microversion: 2.20 time: 0.180574 May 16 20:43:43.498991 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 384/772] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:43:43 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:43:44.523959 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-a6d1b959-df89-4196-b10e-cd3e5d507fca tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:44.525229 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-a6d1b959-df89-4196-b10e-cd3e5d507fca tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:44.533677 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a6d1b959-df89-4196-b10e-cd3e5d507fca tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:44.534134 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a6d1b959-df89-4196-b10e-cd3e5d507fca tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:44.534923 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a6d1b959-df89-4196-b10e-cd3e5d507fca tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:44.535361 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a6d1b959-df89-4196-b10e-cd3e5d507fca tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:44.674347 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a6d1b959-df89-4196-b10e-cd3e5d507fca tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:44.682951 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a6d1b959-df89-4196-b10e-cd3e5d507fca tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:44.684941 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a6d1b959-df89-4196-b10e-cd3e5d507fca tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:44.686119 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-a6d1b959-df89-4196-b10e-cd3e5d507fca tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1723 microversion: 2.20 time: 0.170910 May 16 20:43:44.686658 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 389/773] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:43:44 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:43:45.701520 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-bc8acf0d-ddd5-4237-b8c3-e0a9cc3a04cf req-93f57f2f-0eb4-45c4-b997-42802dc79701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1718fbf6-1460-443d-9fb4-815bf062c594", "name": "network-vif-deleted", "tag": "21b40ca4-40ac-4a3f-9958-fe3007671e02"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:43:45.707074 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-61792ab7-7bae-405e-8688-771d0d64a7ff tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:45.708043 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-61792ab7-7bae-405e-8688-771d0d64a7ff tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:45.718674 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-61792ab7-7bae-405e-8688-771d0d64a7ff tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:45.719461 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-61792ab7-7bae-405e-8688-771d0d64a7ff tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:45.728982 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-bc8acf0d-ddd5-4237-b8c3-e0a9cc3a04cf req-93f57f2f-0eb4-45c4-b997-42802dc79701 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:45.730810 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-bc8acf0d-ddd5-4237-b8c3-e0a9cc3a04cf req-93f57f2f-0eb4-45c4-b997-42802dc79701 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:45.734045 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-61792ab7-7bae-405e-8688-771d0d64a7ff tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:45.735759 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-61792ab7-7bae-405e-8688-771d0d64a7ff tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:45.754441 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-bc8acf0d-ddd5-4237-b8c3-e0a9cc3a04cf req-93f57f2f-0eb4-45c4-b997-42802dc79701 service nova] Creating event network-vif-deleted:21b40ca4-40ac-4a3f-9958-fe3007671e02 for instance 1718fbf6-1460-443d-9fb4-815bf062c594 on hv-cinder-77703 May 16 20:43:45.761135 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-bc8acf0d-ddd5-4237-b8c3-e0a9cc3a04cf req-93f57f2f-0eb4-45c4-b997-42802dc79701 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063478 May 16 20:43:45.762522 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 385/774] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:43:45.840421 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-61792ab7-7bae-405e-8688-771d0d64a7ff tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:45.851977 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-61792ab7-7bae-405e-8688-771d0d64a7ff tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:45.854940 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-61792ab7-7bae-405e-8688-771d0d64a7ff tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3dd9262fba4830be6c4477628f2061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970ed3a09b3e490399fa39d38e97f9cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:45.857459 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-61792ab7-7bae-405e-8688-771d0d64a7ff tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 200 len: 1366 microversion: 2.20 time: 0.154281 May 16 20:43:45.858080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 390/775] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:43:45 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 20:43:46.877282 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-60be2641-55a8-4c00-bee7-67867b7e0ae0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:46.877986 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-60be2641-55a8-4c00-bee7-67867b7e0ae0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:46.884195 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-60be2641-55a8-4c00-bee7-67867b7e0ae0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:46.885464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-60be2641-55a8-4c00-bee7-67867b7e0ae0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:46.886326 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-60be2641-55a8-4c00-bee7-67867b7e0ae0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:46.886794 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-60be2641-55a8-4c00-bee7-67867b7e0ae0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:46.905236 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-60be2641-55a8-4c00-bee7-67867b7e0ae0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] HTTP exception thrown: Instance 1718fbf6-1460-443d-9fb4-815bf062c594 could not be found. May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-60be2641-55a8-4c00-bee7-67867b7e0ae0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Request method failure captured: May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 HTTP/1.1 May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrXoLTgXBu2xvGXxniUO9w0EwBsqSDI4EjO3QsEtz1Lg3OjWIY__JEzBqV0Efgt24a4DXjogDT_An7urBtEVrgmqC_7D2xmphytiOKpqdPPWdB9pfIYb86Y_EMxNuj0APgND3mqALDL5Xgaj63HIMbLh1DMQUsecwGEZ_dGFr1JigMc May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Openstack-Nova-Api-Version: 2.20 May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 970ed3a09b3e490399fa39d38e97f9cb May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1446291240 May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:43:46.906942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:43:46.908530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_970ed3a09b3e490399fa39d38e97f9cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/970ed3a09b3e490399fa39d38e97f9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/970ed3a09b3e490399fa39d38e97f9cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/970ed3a09b3e490399fa39d38e97f9cb"}]}] May 16 20:43:46.908530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1446291240 May 16 20:43:46.908530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 970ed3a09b3e490399fa39d38e97f9cb May 16 20:43:46.908530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1446291240 May 16 20:43:46.908530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-AttachVolumeShelveTestJSON-1446291240-project May 16 20:43:46.908530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:43:46.908530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:43:46.908530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: de3dd9262fba4830be6c4477628f2061 May 16 20:43:46.908530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1446291240-project May 16 20:43:46.908530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:43:46.908530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance 1718fbf6-1460-443d-9fb4-815bf062c594 could not be found. May 16 20:43:46.908530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': '1718fbf6-1460-443d-9fb4-815bf062c594'} May 16 20:43:46.909294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:43:46.909294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:46.909294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:43:46.909294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:43:46.909294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:43:46.909294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:43:46.909294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:43:46.909294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:43:46.909294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:43:46.909294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:43:46.909294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1718fbf6-1460-443d-9fb4-815bf062c594 could not be found. May 16 20:43:46.909294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:46.909294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:46.909294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:46.909294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:46.909294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:46.909294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:46.909294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:43:46.909294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:43:46.909294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:43:46.910540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:43:46.910540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:43:46.910540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:43:46.910540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:43:46.910540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:43:46.910540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:43:46.910540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:43:46.910540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1718fbf6-1460-443d-9fb4-815bf062c594 could not be found. May 16 20:43:46.910540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:46.910540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:46.910540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:46.910540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:46.910540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:46.910540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:46.910540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:43:46.910540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:43:46.910540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1718fbf6-1460-443d-9fb4-815bf062c594 could not be found. May 16 20:43:46.910540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:46.912810 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-60be2641-55a8-4c00-bee7-67867b7e0ae0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Returning 404 to user: Instance 1718fbf6-1460-443d-9fb4-815bf062c594 could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:43:46.912810 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-60be2641-55a8-4c00-bee7-67867b7e0ae0 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 404 len: 111 microversion: 2.20 time: 0.036442 May 16 20:43:46.912810 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 386/776] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:43:46 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 20:43:46.917521 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-444741ae-8755-457c-a184-e2486cd2d68f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '.version_select at 0x7f81b10f5a60>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:46.955565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-444741ae-8755-457c-a184-e2486cd2d68f tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525470111" status: 204 len: 0 microversion: 2.20 time: 0.041837 May 16 20:43:46.956480 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 391/777] 10.222.0.49 () {60 vars in 1261 bytes} [Mon May 16 20:43:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525470111 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 20:43:48.806696 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-40d7f8cf-6ed1-462a-9605-cf85b0b66d7c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:48.807297 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-40d7f8cf-6ed1-462a-9605-cf85b0b66d7c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:48.814860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-40d7f8cf-6ed1-462a-9605-cf85b0b66d7c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:48.815310 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-40d7f8cf-6ed1-462a-9605-cf85b0b66d7c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:48.816139 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-40d7f8cf-6ed1-462a-9605-cf85b0b66d7c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:48.816594 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-40d7f8cf-6ed1-462a-9605-cf85b0b66d7c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:48.830519 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-40d7f8cf-6ed1-462a-9605-cf85b0b66d7c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] HTTP exception thrown: Instance 1718fbf6-1460-443d-9fb4-815bf062c594 could not be found. May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-40d7f8cf-6ed1-462a-9605-cf85b0b66d7c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Request method failure captured: May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: DELETE /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 HTTP/1.1 May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrXoLTgXBu2xvGXxniUO9w0EwBsqSDI4EjO3QsEtz1Lg3OjWIY__JEzBqV0Efgt24a4DXjogDT_An7urBtEVrgmqC_7D2xmphytiOKpqdPPWdB9pfIYb86Y_EMxNuj0APgND3mqALDL5Xgaj63HIMbLh1DMQUsecwGEZ_dGFr1JigMc May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Openstack-Nova-Api-Version: 2.20 May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 970ed3a09b3e490399fa39d38e97f9cb May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1446291240 May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:43:48.832169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:43:48.833680 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_970ed3a09b3e490399fa39d38e97f9cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/970ed3a09b3e490399fa39d38e97f9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/970ed3a09b3e490399fa39d38e97f9cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/970ed3a09b3e490399fa39d38e97f9cb"}]}] May 16 20:43:48.833680 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1446291240 May 16 20:43:48.833680 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 970ed3a09b3e490399fa39d38e97f9cb May 16 20:43:48.833680 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1446291240 May 16 20:43:48.833680 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-AttachVolumeShelveTestJSON-1446291240-project May 16 20:43:48.833680 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:43:48.833680 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:43:48.833680 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: de3dd9262fba4830be6c4477628f2061 May 16 20:43:48.833680 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1446291240-project May 16 20:43:48.833680 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:43:48.833680 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance 1718fbf6-1460-443d-9fb4-815bf062c594 could not be found. May 16 20:43:48.833680 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': '1718fbf6-1460-443d-9fb4-815bf062c594'} May 16 20:43:48.834491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:43:48.834491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:48.834491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:43:48.834491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:43:48.834491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:43:48.834491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:43:48.834491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:43:48.834491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:43:48.834491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:43:48.834491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:43:48.834491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1718fbf6-1460-443d-9fb4-815bf062c594 could not be found. May 16 20:43:48.834491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:48.834491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:48.834491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:48.834491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:48.834491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:48.834491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:48.834491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:43:48.834491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:43:48.834491 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:43:48.835751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:43:48.835751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 20:43:48.835751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 20:43:48.835751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 20:43:48.835751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 20:43:48.835751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:43:48.835751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:43:48.835751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:43:48.835751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:43:48.835751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1718fbf6-1460-443d-9fb4-815bf062c594 could not be found. May 16 20:43:48.835751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:48.835751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:48.835751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:48.835751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:48.835751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:48.835751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:48.835751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:43:48.835751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:43:48.835751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1718fbf6-1460-443d-9fb4-815bf062c594 could not be found. May 16 20:43:48.835751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:48.842379 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-40d7f8cf-6ed1-462a-9605-cf85b0b66d7c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Returning 404 to user: Instance 1718fbf6-1460-443d-9fb4-815bf062c594 could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:43:48.842379 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-40d7f8cf-6ed1-462a-9605-cf85b0b66d7c tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 404 len: 111 microversion: 2.20 time: 0.030800 May 16 20:43:48.842379 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 387/778] 10.222.0.49 () {60 vars in 1279 bytes} [Mon May 16 20:43:48 2022] DELETE /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 20:43:48.843932 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7f29ff0f-0d97-4523-a889-ca4e2c3f61be tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:48.844568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-7f29ff0f-0d97-4523-a889-ca4e2c3f61be tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 1718fbf6-1460-443d-9fb4-815bf062c594] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:48.854186 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7f29ff0f-0d97-4523-a889-ca4e2c3f61be tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:48.854634 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7f29ff0f-0d97-4523-a889-ca4e2c3f61be tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:48.855426 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7f29ff0f-0d97-4523-a889-ca4e2c3f61be tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:48.855850 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7f29ff0f-0d97-4523-a889-ca4e2c3f61be tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:48.869170 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-7f29ff0f-0d97-4523-a889-ca4e2c3f61be tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] HTTP exception thrown: Instance 1718fbf6-1460-443d-9fb4-815bf062c594 could not be found. May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7f29ff0f-0d97-4523-a889-ca4e2c3f61be tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Request method failure captured: May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 HTTP/1.1 May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrXoLTgXBu2xvGXxniUO9w0EwBsqSDI4EjO3QsEtz1Lg3OjWIY__JEzBqV0Efgt24a4DXjogDT_An7urBtEVrgmqC_7D2xmphytiOKpqdPPWdB9pfIYb86Y_EMxNuj0APgND3mqALDL5Xgaj63HIMbLh1DMQUsecwGEZ_dGFr1JigMc May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Openstack-Nova-Api-Version: 2.20 May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 970ed3a09b3e490399fa39d38e97f9cb May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1446291240 May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:43:48.870818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:43:48.872346 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_970ed3a09b3e490399fa39d38e97f9cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/970ed3a09b3e490399fa39d38e97f9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/970ed3a09b3e490399fa39d38e97f9cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/970ed3a09b3e490399fa39d38e97f9cb"}]}] May 16 20:43:48.872346 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1446291240 May 16 20:43:48.872346 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 970ed3a09b3e490399fa39d38e97f9cb May 16 20:43:48.872346 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1446291240 May 16 20:43:48.872346 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-AttachVolumeShelveTestJSON-1446291240-project May 16 20:43:48.872346 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:43:48.872346 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:43:48.872346 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: de3dd9262fba4830be6c4477628f2061 May 16 20:43:48.872346 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1446291240-project May 16 20:43:48.872346 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: > May 16 20:43:48.872346 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Instance 1718fbf6-1460-443d-9fb4-815bf062c594 could not be found. May 16 20:43:48.872346 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': '1718fbf6-1460-443d-9fb4-815bf062c594'} May 16 20:43:48.873208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:43:48.873208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:48.873208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:43:48.873208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:43:48.873208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:43:48.873208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:43:48.873208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:43:48.873208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:43:48.873208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:43:48.873208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:43:48.873208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1718fbf6-1460-443d-9fb4-815bf062c594 could not be found. May 16 20:43:48.873208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:48.873208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:48.873208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:48.873208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:48.873208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:48.873208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:48.873208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:43:48.873208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:43:48.873208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:43:48.874446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:43:48.874446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:43:48.874446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:43:48.874446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:43:48.874446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:43:48.874446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:43:48.874446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:43:48.874446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1718fbf6-1460-443d-9fb4-815bf062c594 could not be found. May 16 20:43:48.874446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:48.874446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:48.874446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:48.874446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:48.874446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:48.874446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:48.874446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:43:48.874446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:43:48.874446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1718fbf6-1460-443d-9fb4-815bf062c594 could not be found. May 16 20:43:48.874446 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:48.875644 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7f29ff0f-0d97-4523-a889-ca4e2c3f61be tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Returning 404 to user: Instance 1718fbf6-1460-443d-9fb4-815bf062c594 could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:43:48.875644 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-7f29ff0f-0d97-4523-a889-ca4e2c3f61be tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594" status: 404 len: 111 microversion: 2.20 time: 0.033290 May 16 20:43:48.875644 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 392/779] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:43:48 2022] GET /compute/v2.1/servers/1718fbf6-1460-443d-9fb4-815bf062c594 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 20:43:50.025907 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-5d4fd65d-79b8-4898-afbd-3d4ac9369487 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:50.025907 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-5d4fd65d-79b8-4898-afbd-3d4ac9369487 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:50.027246 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5d4fd65d-79b8-4898-afbd-3d4ac9369487 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:50.027953 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5d4fd65d-79b8-4898-afbd-3d4ac9369487 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:50.029047 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5d4fd65d-79b8-4898-afbd-3d4ac9369487 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:50.029810 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5d4fd65d-79b8-4898-afbd-3d4ac9369487 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:50.053106 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-5d4fd65d-79b8-4898-afbd-3d4ac9369487 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] HTTP exception thrown: Instance 6f8d450f-828f-4002-b649-ff13d14a047c could not be found. May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-5d4fd65d-79b8-4898-afbd-3d4ac9369487 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Request method failure captured: May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: DELETE /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c HTTP/1.1 May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrXoLTgXBu2xvGXxniUO9w0EwBsqSDI4EjO3QsEtz1Lg3OjWIY__JEzBqV0Efgt24a4DXjogDT_An7urBtEVrgmqC_7D2xmphytiOKpqdPPWdB9pfIYb86Y_EMxNuj0APgND3mqALDL5Xgaj63HIMbLh1DMQUsecwGEZ_dGFr1JigMc May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Openstack-Nova-Api-Version: 2.20 May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 970ed3a09b3e490399fa39d38e97f9cb May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1446291240 May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:43:50.054677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:43:50.056172 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_970ed3a09b3e490399fa39d38e97f9cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/970ed3a09b3e490399fa39d38e97f9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/970ed3a09b3e490399fa39d38e97f9cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/970ed3a09b3e490399fa39d38e97f9cb"}]}] May 16 20:43:50.056172 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1446291240 May 16 20:43:50.056172 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 970ed3a09b3e490399fa39d38e97f9cb May 16 20:43:50.056172 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1446291240 May 16 20:43:50.056172 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-AttachVolumeShelveTestJSON-1446291240-project May 16 20:43:50.056172 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:43:50.056172 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:43:50.056172 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: de3dd9262fba4830be6c4477628f2061 May 16 20:43:50.056172 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1446291240-project May 16 20:43:50.056172 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:43:50.056172 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance 6f8d450f-828f-4002-b649-ff13d14a047c could not be found. May 16 20:43:50.056172 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': '6f8d450f-828f-4002-b649-ff13d14a047c'} May 16 20:43:50.056985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:43:50.056985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:50.056985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:43:50.056985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:43:50.056985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:43:50.056985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:43:50.056985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:43:50.056985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:43:50.056985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:43:50.056985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:43:50.056985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f8d450f-828f-4002-b649-ff13d14a047c could not be found. May 16 20:43:50.056985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:50.056985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:50.056985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:50.056985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:50.056985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:50.056985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:50.056985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:43:50.056985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:43:50.056985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:43:50.058853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:43:50.058853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 20:43:50.058853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 20:43:50.058853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 20:43:50.058853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 20:43:50.058853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:43:50.058853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:43:50.058853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:43:50.058853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:43:50.058853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f8d450f-828f-4002-b649-ff13d14a047c could not be found. May 16 20:43:50.058853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:50.058853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:50.058853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:50.058853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:50.058853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:50.058853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:50.058853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:43:50.058853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:43:50.058853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f8d450f-828f-4002-b649-ff13d14a047c could not be found. May 16 20:43:50.058853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:43:50.060754 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-5d4fd65d-79b8-4898-afbd-3d4ac9369487 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Returning 404 to user: Instance 6f8d450f-828f-4002-b649-ff13d14a047c could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:43:50.060754 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-5d4fd65d-79b8-4898-afbd-3d4ac9369487 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 404 len: 111 microversion: 2.20 time: 0.039782 May 16 20:43:50.060754 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 388/780] 10.222.0.49 () {60 vars in 1279 bytes} [Mon May 16 20:43:50 2022] DELETE /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 20:43:50.065233 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-9189254c-cdeb-47ad-81ee-3a320dc6bb13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:50.065914 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-9189254c-cdeb-47ad-81ee-3a320dc6bb13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] [instance: 6f8d450f-828f-4002-b649-ff13d14a047c] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:50.073070 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9189254c-cdeb-47ad-81ee-3a320dc6bb13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:50.073516 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9189254c-cdeb-47ad-81ee-3a320dc6bb13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:50.074301 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9189254c-cdeb-47ad-81ee-3a320dc6bb13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:50.074784 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9189254c-cdeb-47ad-81ee-3a320dc6bb13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:50.089460 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-9189254c-cdeb-47ad-81ee-3a320dc6bb13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] HTTP exception thrown: Instance 6f8d450f-828f-4002-b649-ff13d14a047c could not be found. May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-9189254c-cdeb-47ad-81ee-3a320dc6bb13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Request method failure captured: May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c HTTP/1.1 May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrXoLTgXBu2xvGXxniUO9w0EwBsqSDI4EjO3QsEtz1Lg3OjWIY__JEzBqV0Efgt24a4DXjogDT_An7urBtEVrgmqC_7D2xmphytiOKpqdPPWdB9pfIYb86Y_EMxNuj0APgND3mqALDL5Xgaj63HIMbLh1DMQUsecwGEZ_dGFr1JigMc May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Openstack-Nova-Api-Version: 2.20 May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 970ed3a09b3e490399fa39d38e97f9cb May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1446291240 May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:43:50.091080 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:43:50.092826 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_970ed3a09b3e490399fa39d38e97f9cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/970ed3a09b3e490399fa39d38e97f9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/970ed3a09b3e490399fa39d38e97f9cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/970ed3a09b3e490399fa39d38e97f9cb"}]}] May 16 20:43:50.092826 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1446291240 May 16 20:43:50.092826 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 970ed3a09b3e490399fa39d38e97f9cb May 16 20:43:50.092826 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1446291240 May 16 20:43:50.092826 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-AttachVolumeShelveTestJSON-1446291240-project May 16 20:43:50.092826 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:43:50.092826 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:43:50.092826 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: de3dd9262fba4830be6c4477628f2061 May 16 20:43:50.092826 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1446291240-project May 16 20:43:50.092826 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: > May 16 20:43:50.092826 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Instance 6f8d450f-828f-4002-b649-ff13d14a047c could not be found. May 16 20:43:50.092826 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': '6f8d450f-828f-4002-b649-ff13d14a047c'} May 16 20:43:50.093756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:43:50.093756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:50.093756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:43:50.093756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:43:50.093756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:43:50.093756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:43:50.093756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:43:50.093756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:43:50.093756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:43:50.093756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:43:50.093756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f8d450f-828f-4002-b649-ff13d14a047c could not be found. May 16 20:43:50.093756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:50.093756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:50.093756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:50.093756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:50.093756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:50.093756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:50.093756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:43:50.093756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:43:50.093756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:43:50.095056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:43:50.095056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:43:50.095056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:43:50.095056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:43:50.095056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:43:50.095056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:43:50.095056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:43:50.095056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f8d450f-828f-4002-b649-ff13d14a047c could not be found. May 16 20:43:50.095056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:50.095056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:43:50.095056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:50.095056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:43:50.095056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:43:50.095056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:43:50.095056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:43:50.095056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:43:50.095056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f8d450f-828f-4002-b649-ff13d14a047c could not be found. May 16 20:43:50.095056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:43:50.096186 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-9189254c-cdeb-47ad-81ee-3a320dc6bb13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] Returning 404 to user: Instance 6f8d450f-828f-4002-b649-ff13d14a047c could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:43:50.096186 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-9189254c-cdeb-47ad-81ee-3a320dc6bb13 tempest-AttachVolumeShelveTestJSON-1446291240 tempest-AttachVolumeShelveTestJSON-1446291240-project] 10.222.0.49 "GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c" status: 404 len: 111 microversion: 2.20 time: 0.031211 May 16 20:43:50.097237 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 393/781] 10.222.0.49 () {60 vars in 1276 bytes} [Mon May 16 20:43:50 2022] GET /compute/v2.1/servers/6f8d450f-828f-4002-b649-ff13d14a047c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 16 20:43:51.678307 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-42792ffe-493f-4e47-b74a-ce3f541207a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2002415882", "imageRef": "f9826e12-1d0c-4a5a-9616-338520403016", "flavorRef": "452", "networks": [{"uuid": "e1a25354-c73e-4477-9767-fb33921f0f33"}]}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:43:51.733275 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.network.neutron [None req-42792ffe-493f-4e47-b74a-ce3f541207a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] validate_networks() for [('e1a25354-c73e-4477-9767-fb33921f0f33', None, None, None, None, None)] {{(pid=123564) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:43:52.586590 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-42792ffe-493f-4e47-b74a-ce3f541207a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Flavor limits 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:43:52.587015 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-42792ffe-493f-4e47-b74a-ce3f541207a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Image limits 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:43:52.587489 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-42792ffe-493f-4e47-b74a-ce3f541207a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Flavor pref 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:43:52.587900 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-42792ffe-493f-4e47-b74a-ce3f541207a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Image pref 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:43:52.588339 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-42792ffe-493f-4e47-b74a-ce3f541207a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:43:52.598426 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-42792ffe-493f-4e47-b74a-ce3f541207a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:52.598930 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-42792ffe-493f-4e47-b74a-ce3f541207a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:52.599751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-42792ffe-493f-4e47-b74a-ce3f541207a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:52.600191 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-42792ffe-493f-4e47-b74a-ce3f541207a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:52.618545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-42792ffe-493f-4e47-b74a-ce3f541207a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Getting quotas for project 579a6c29476643ed997c798ed64bc409. Resources: {'cores', 'ram', 'instances'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:43:52.622945 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-42792ffe-493f-4e47-b74a-ce3f541207a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Getting quotas for user 28b413f53d6e404fa3d613d21d07afc7 and project 579a6c29476643ed997c798ed64bc409. Resources: {'cores', 'ram', 'instances'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:43:52.635059 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-42792ffe-493f-4e47-b74a-ce3f541207a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Going to run 1 instances... {{(pid=123564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:43:52.637549 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-42792ffe-493f-4e47-b74a-ce3f541207a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 936a70bc-4d81-45d3-8266-58a369120074] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9826e12-1d0c-4a5a-9616-338520403016',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:43:52.693151 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-42792ffe-493f-4e47-b74a-ce3f541207a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.018922 May 16 20:43:52.694178 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 389/782] 10.222.0.49 () {60 vars in 1146 bytes} [Mon May 16 20:43:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 20:43:52.703899 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-a5aa5795-3a33-405e-a562-52a7d05561b1 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:52.705076 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-a5aa5795-3a33-405e-a562-52a7d05561b1 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 936a70bc-4d81-45d3-8266-58a369120074] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:52.775847 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a5aa5795-3a33-405e-a562-52a7d05561b1 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:52.785548 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-a5aa5795-3a33-405e-a562-52a7d05561b1 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074" status: 200 len: 1219 microversion: 2.1 time: 0.085497 May 16 20:43:52.786778 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 394/783] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:52 2022] GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:53.803533 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6c1ef883-25b1-478d-89ba-eabd0677410c tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:53.805493 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-6c1ef883-25b1-478d-89ba-eabd0677410c tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 936a70bc-4d81-45d3-8266-58a369120074] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:53.813731 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6c1ef883-25b1-478d-89ba-eabd0677410c tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:53.814445 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6c1ef883-25b1-478d-89ba-eabd0677410c tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:53.815468 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6c1ef883-25b1-478d-89ba-eabd0677410c tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:53.816110 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6c1ef883-25b1-478d-89ba-eabd0677410c tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:53.912158 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6c1ef883-25b1-478d-89ba-eabd0677410c tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:53.920767 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-6c1ef883-25b1-478d-89ba-eabd0677410c tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074" status: 200 len: 1279 microversion: 2.1 time: 0.121573 May 16 20:43:53.930889 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 390/784] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:53 2022] GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074 => generated 1279 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:54.938637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-04ca75b4-d377-4084-8b4e-a12219a9c49b tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:54.940070 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-04ca75b4-d377-4084-8b4e-a12219a9c49b tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 936a70bc-4d81-45d3-8266-58a369120074] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:54.949048 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-04ca75b4-d377-4084-8b4e-a12219a9c49b tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:54.949578 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-04ca75b4-d377-4084-8b4e-a12219a9c49b tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:54.950818 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-04ca75b4-d377-4084-8b4e-a12219a9c49b tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:54.951346 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-04ca75b4-d377-4084-8b4e-a12219a9c49b tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:55.148796 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-04ca75b4-d377-4084-8b4e-a12219a9c49b tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:55.161000 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-04ca75b4-d377-4084-8b4e-a12219a9c49b tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074" status: 200 len: 1319 microversion: 2.1 time: 0.226355 May 16 20:43:55.171717 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 395/785] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:54 2022] GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:55.309555 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-869663c4-ea41-4adb-93d4-dd2650c19537 req-536bff3f-3348-4251-a35e-bb9655f3b3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "936a70bc-4d81-45d3-8266-58a369120074", "tag": "50e7f551-385d-4e2f-b318-b43340cbd079"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:43:55.324266 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-869663c4-ea41-4adb-93d4-dd2650c19537 req-536bff3f-3348-4251-a35e-bb9655f3b3f9 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:55.325617 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-869663c4-ea41-4adb-93d4-dd2650c19537 req-536bff3f-3348-4251-a35e-bb9655f3b3f9 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:55.338851 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-869663c4-ea41-4adb-93d4-dd2650c19537 req-536bff3f-3348-4251-a35e-bb9655f3b3f9 service nova] Creating event network-changed:50e7f551-385d-4e2f-b318-b43340cbd079 for instance 936a70bc-4d81-45d3-8266-58a369120074 on hv-cinder-77703 May 16 20:43:55.344817 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-869663c4-ea41-4adb-93d4-dd2650c19537 req-536bff3f-3348-4251-a35e-bb9655f3b3f9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041057 May 16 20:43:55.345977 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 391/786] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:43:55.617950 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-8ff744d6-13ab-4346-876d-d6b1b9ceb05e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1205096536", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-532846035", "security_groups": [{"name": "tempest-secgroup-smoke-444227453"}], "networks": [{"uuid": "f903b382-f9f4-430f-b401-6775eaafb5d2"}], "block_device_mapping_v2": [{"uuid": "ddd7386f-7703-4a72-8c92-13b7bdad871e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:43:55.810573 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.network.neutron [None req-8ff744d6-13ab-4346-876d-d6b1b9ceb05e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] validate_networks() for [('f903b382-f9f4-430f-b401-6775eaafb5d2', None, None, None, None, None)] {{(pid=123563) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:43:56.180804 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-0586c866-be50-4f01-b416-b4a1121db8a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:56.181942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-0586c866-be50-4f01-b416-b4a1121db8a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 936a70bc-4d81-45d3-8266-58a369120074] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:56.189799 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0586c866-be50-4f01-b416-b4a1121db8a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:56.190474 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0586c866-be50-4f01-b416-b4a1121db8a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:56.191516 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0586c866-be50-4f01-b416-b4a1121db8a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:56.192201 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0586c866-be50-4f01-b416-b4a1121db8a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:56.360424 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-8ff744d6-13ab-4346-876d-d6b1b9ceb05e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Flavor limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:43:56.361688 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-8ff744d6-13ab-4346-876d-d6b1b9ceb05e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Image limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:43:56.362959 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-8ff744d6-13ab-4346-876d-d6b1b9ceb05e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Flavor pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:43:56.363590 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-8ff744d6-13ab-4346-876d-d6b1b9ceb05e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Image pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:43:56.364232 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-8ff744d6-13ab-4346-876d-d6b1b9ceb05e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:43:56.374962 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8ff744d6-13ab-4346-876d-d6b1b9ceb05e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:56.375753 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8ff744d6-13ab-4346-876d-d6b1b9ceb05e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:56.376790 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8ff744d6-13ab-4346-876d-d6b1b9ceb05e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:56.377932 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8ff744d6-13ab-4346-876d-d6b1b9ceb05e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:56.389813 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-0586c866-be50-4f01-b416-b4a1121db8a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:56.397105 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-8ff744d6-13ab-4346-876d-d6b1b9ceb05e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Getting quotas for project eb89e1020d944ea08b4294be0ac00cbf. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:43:56.398730 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-0586c866-be50-4f01-b416-b4a1121db8a5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074" status: 200 len: 1319 microversion: 2.1 time: 0.222599 May 16 20:43:56.402459 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-8ff744d6-13ab-4346-876d-d6b1b9ceb05e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Getting quotas for user 7efe317417084146a0ff20116ed48cbb and project eb89e1020d944ea08b4294be0ac00cbf. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:43:56.409042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 392/787] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:56 2022] GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:56.471421 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-8ff744d6-13ab-4346-876d-d6b1b9ceb05e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Going to run 1 instances... {{(pid=123563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:43:56.473559 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-8ff744d6-13ab-4346-876d-d6b1b9ceb05e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ddd7386f-7703-4a72-8c92-13b7bdad871e',volume_size=None,volume_type=None)] {{(pid=123563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:43:56.621967 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-8ff744d6-13ab-4346-876d-d6b1b9ceb05e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.007786 May 16 20:43:56.623242 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 396/788] 10.222.0.49 () {60 vars in 1146 bytes} [Mon May 16 20:43:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 20:43:56.633389 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-4a8ba5af-e250-4f78-829c-5b1b312b662c tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:56.633999 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-4a8ba5af-e250-4f78-829c-5b1b312b662c tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:56.698830 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-4a8ba5af-e250-4f78-829c-5b1b312b662c tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:56.708502 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-4a8ba5af-e250-4f78-829c-5b1b312b662c tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1088 microversion: 2.1 time: 0.078567 May 16 20:43:56.718234 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 393/789] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:56 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:57.417871 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-19ae45db-8d45-4c41-8196-1489c6228dde tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:57.419483 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-19ae45db-8d45-4c41-8196-1489c6228dde tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 936a70bc-4d81-45d3-8266-58a369120074] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:57.442373 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-19ae45db-8d45-4c41-8196-1489c6228dde tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:57.446415 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-19ae45db-8d45-4c41-8196-1489c6228dde tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:57.450091 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-19ae45db-8d45-4c41-8196-1489c6228dde tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:57.450558 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-19ae45db-8d45-4c41-8196-1489c6228dde tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:57.726537 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-ec8e7dfd-7a43-4efa-a206-be015b5b5d16 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:57.727309 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-ec8e7dfd-7a43-4efa-a206-be015b5b5d16 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:57.738051 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ec8e7dfd-7a43-4efa-a206-be015b5b5d16 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:57.738526 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ec8e7dfd-7a43-4efa-a206-be015b5b5d16 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:57.739363 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ec8e7dfd-7a43-4efa-a206-be015b5b5d16 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:57.739802 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ec8e7dfd-7a43-4efa-a206-be015b5b5d16 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:57.887830 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-19ae45db-8d45-4c41-8196-1489c6228dde tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:57.896954 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-19ae45db-8d45-4c41-8196-1489c6228dde tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074" status: 200 len: 1319 microversion: 2.1 time: 0.484440 May 16 20:43:57.897546 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 397/790] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:57 2022] GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074 => generated 1319 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:57.909561 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-ec8e7dfd-7a43-4efa-a206-be015b5b5d16 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:57.922817 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-ec8e7dfd-7a43-4efa-a206-be015b5b5d16 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1186 microversion: 2.1 time: 0.200330 May 16 20:43:57.923804 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 394/791] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:57 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1186 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:58.914954 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0269116e-8533-4533-80d2-356304129e6f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:58.916263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0269116e-8533-4533-80d2-356304129e6f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 936a70bc-4d81-45d3-8266-58a369120074] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:58.931757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0269116e-8533-4533-80d2-356304129e6f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:58.932535 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0269116e-8533-4533-80d2-356304129e6f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:58.933644 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0269116e-8533-4533-80d2-356304129e6f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:58.934740 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0269116e-8533-4533-80d2-356304129e6f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:58.942961 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-3a8d3f5b-4e63-4d79-bd58-b3673ca25850 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:43:58.944369 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-3a8d3f5b-4e63-4d79-bd58-b3673ca25850 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:43:58.958197 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3a8d3f5b-4e63-4d79-bd58-b3673ca25850 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:58.959527 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3a8d3f5b-4e63-4d79-bd58-b3673ca25850 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:58.962950 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3a8d3f5b-4e63-4d79-bd58-b3673ca25850 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:43:58.963580 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3a8d3f5b-4e63-4d79-bd58-b3673ca25850 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:43:59.399059 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3a8d3f5b-4e63-4d79-bd58-b3673ca25850 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:59.417072 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-3a8d3f5b-4e63-4d79-bd58-b3673ca25850 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1259 microversion: 2.1 time: 0.479321 May 16 20:43:59.418527 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 395/792] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:58 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1259 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:43:59.662328 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-0269116e-8533-4533-80d2-356304129e6f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:43:59.674893 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0269116e-8533-4533-80d2-356304129e6f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074" status: 200 len: 1319 microversion: 2.1 time: 0.764490 May 16 20:43:59.675495 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 398/793] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:43:58 2022] GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074 => generated 1319 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:00.174578 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-1debb5cf-2a9d-4c01-bb46-6835aa202512 req-8387e3a5-de54-4dee-903a-483a7518a8ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd4c11b0-f517-4783-99ec-8a010cb5dbb8", "tag": "29979fec-638a-4157-bbd7-3f1f941c944e"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:44:00.186181 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-1debb5cf-2a9d-4c01-bb46-6835aa202512 req-8387e3a5-de54-4dee-903a-483a7518a8ad service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:00.186686 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-1debb5cf-2a9d-4c01-bb46-6835aa202512 req-8387e3a5-de54-4dee-903a-483a7518a8ad service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:00.203960 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-1debb5cf-2a9d-4c01-bb46-6835aa202512 req-8387e3a5-de54-4dee-903a-483a7518a8ad service nova] Creating event network-changed:29979fec-638a-4157-bbd7-3f1f941c944e for instance cd4c11b0-f517-4783-99ec-8a010cb5dbb8 on hv-cinder-77703 May 16 20:44:00.209645 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-1debb5cf-2a9d-4c01-bb46-6835aa202512 req-8387e3a5-de54-4dee-903a-483a7518a8ad service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039573 May 16 20:44:00.210929 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 396/794] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:44:00.433792 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2f7a6d03-9be8-41bb-b97d-f7466ddd524a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Action: 'create', calling method: .version_select at 0x7f81b104fb80>, body: {"keypair": {"name": "tempest-keypair-1264121086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQTU0U4XJWCijC/iZano80QRxJ4hLYXqprrGGEmsckEgcxG0MZyYW1931eIDDA0/bFBQ1hSV0PlrBMqgHGOk4znGuAjPeOuHJDK7teQhC2ximYAfc75g6FMCHaIUQ8egg=="}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:44:00.435807 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-1b8b1476-089a-406e-b050-2b7712163c86 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:00.436579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-1b8b1476-089a-406e-b050-2b7712163c86 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:00.448711 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1b8b1476-089a-406e-b050-2b7712163c86 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:00.449177 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1b8b1476-089a-406e-b050-2b7712163c86 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:00.450044 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1b8b1476-089a-406e-b050-2b7712163c86 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:00.450486 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1b8b1476-089a-406e-b050-2b7712163c86 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:00.451777 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-2f7a6d03-9be8-41bb-b97d-f7466ddd524a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Getting quotas for project 1ccbb9b8d11b499cb9e84da27dd464e6. Resources: {'key_pairs'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:44:00.457422 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-2f7a6d03-9be8-41bb-b97d-f7466ddd524a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Getting quotas for user 0e56ccc11ac043af908dbfe3a10c9a55 and project 1ccbb9b8d11b499cb9e84da27dd464e6. Resources: {'key_pairs'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:44:00.495861 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-2f7a6d03-9be8-41bb-b97d-f7466ddd524a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.212598 May 16 20:44:00.501819 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 399/795] 10.222.0.49 () {60 vars in 1158 bytes} [Mon May 16 20:44:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:44:00.693847 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-60662c70-94ea-4caa-bda4-6af8d301ed2b tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:00.694465 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-60662c70-94ea-4caa-bda4-6af8d301ed2b tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 936a70bc-4d81-45d3-8266-58a369120074] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:00.705759 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-60662c70-94ea-4caa-bda4-6af8d301ed2b tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:00.706417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-60662c70-94ea-4caa-bda4-6af8d301ed2b tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:00.707397 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-60662c70-94ea-4caa-bda4-6af8d301ed2b tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:00.708373 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-60662c70-94ea-4caa-bda4-6af8d301ed2b tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:00.827192 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-1b8b1476-089a-406e-b050-2b7712163c86 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:00.838084 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-1b8b1476-089a-406e-b050-2b7712163c86 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1259 microversion: 2.1 time: 0.407048 May 16 20:44:00.839326 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 397/796] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:00 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1259 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:44:00.926296 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-a8b510a2-12b7-4c6b-86f7-9c6c303c6f5c req-6e89ec9c-2ae7-4062-862a-6e0a0c10f8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "936a70bc-4d81-45d3-8266-58a369120074", "name": "network-vif-plugged", "status": "completed", "tag": "50e7f551-385d-4e2f-b318-b43340cbd079"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:44:00.943274 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-a8b510a2-12b7-4c6b-86f7-9c6c303c6f5c req-6e89ec9c-2ae7-4062-862a-6e0a0c10f8e2 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:00.943722 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-a8b510a2-12b7-4c6b-86f7-9c6c303c6f5c req-6e89ec9c-2ae7-4062-862a-6e0a0c10f8e2 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:00.953822 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-60662c70-94ea-4caa-bda4-6af8d301ed2b tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:00.961488 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-60662c70-94ea-4caa-bda4-6af8d301ed2b tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074" status: 200 len: 1319 microversion: 2.1 time: 0.272241 May 16 20:44:00.964806 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 400/797] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:00 2022] GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:44:00.982243 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-a8b510a2-12b7-4c6b-86f7-9c6c303c6f5c req-6e89ec9c-2ae7-4062-862a-6e0a0c10f8e2 service nova] Creating event network-vif-plugged:50e7f551-385d-4e2f-b318-b43340cbd079 for instance 936a70bc-4d81-45d3-8266-58a369120074 on hv-cinder-77703 May 16 20:44:00.997338 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-a8b510a2-12b7-4c6b-86f7-9c6c303c6f5c req-6e89ec9c-2ae7-4062-862a-6e0a0c10f8e2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075390 May 16 20:44:00.998415 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 398/798] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:44:01.855221 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-1bca890e-755a-4e74-bf1e-322fc840c6ee tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:01.855802 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-1bca890e-755a-4e74-bf1e-322fc840c6ee tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:01.864789 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1bca890e-755a-4e74-bf1e-322fc840c6ee tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:01.865353 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1bca890e-755a-4e74-bf1e-322fc840c6ee tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:01.866251 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1bca890e-755a-4e74-bf1e-322fc840c6ee tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:01.866737 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1bca890e-755a-4e74-bf1e-322fc840c6ee tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:01.983780 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-65f8b829-f1de-458a-b13e-b23624802f07 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:01.985396 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-65f8b829-f1de-458a-b13e-b23624802f07 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 936a70bc-4d81-45d3-8266-58a369120074] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:01.992168 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-65f8b829-f1de-458a-b13e-b23624802f07 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:01.992728 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-65f8b829-f1de-458a-b13e-b23624802f07 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:01.993585 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-65f8b829-f1de-458a-b13e-b23624802f07 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:01.994464 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-65f8b829-f1de-458a-b13e-b23624802f07 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:02.022044 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-1bca890e-755a-4e74-bf1e-322fc840c6ee tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:02.030465 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-1bca890e-755a-4e74-bf1e-322fc840c6ee tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1259 microversion: 2.1 time: 0.178984 May 16 20:44:02.031059 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 401/799] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:01 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:02.075660 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-ab22d700-ce24-444d-9a07-2715bfc1641f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2009836287", "imageRef": "f9826e12-1d0c-4a5a-9616-338520403016", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8dc5c47-0d7f-4f3f-bbe1-95454b576a47"}], "security_groups": [{"name": "tempest-securitygroup--757369583"}], "key_name": "tempest-keypair-1264121086", "user_data": "}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:44:02.211162 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-65f8b829-f1de-458a-b13e-b23624802f07 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:02.219042 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-65f8b829-f1de-458a-b13e-b23624802f07 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074" status: 200 len: 1319 microversion: 2.1 time: 0.240997 May 16 20:44:02.219573 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 399/800] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:01 2022] GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:44:02.334894 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.network.neutron [None req-ab22d700-ce24-444d-9a07-2715bfc1641f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] validate_networks() for [('f8dc5c47-0d7f-4f3f-bbe1-95454b576a47', None, None, None, None, None)] {{(pid=123563) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:44:02.814622 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-ab22d700-ce24-444d-9a07-2715bfc1641f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Flavor limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:44:02.815045 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-ab22d700-ce24-444d-9a07-2715bfc1641f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Image limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:44:02.815701 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-ab22d700-ce24-444d-9a07-2715bfc1641f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Flavor pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:44:02.816110 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-ab22d700-ce24-444d-9a07-2715bfc1641f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Image pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:44:02.816903 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-ab22d700-ce24-444d-9a07-2715bfc1641f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:44:02.826927 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ab22d700-ce24-444d-9a07-2715bfc1641f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:02.827720 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ab22d700-ce24-444d-9a07-2715bfc1641f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:02.828557 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ab22d700-ce24-444d-9a07-2715bfc1641f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:02.828996 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ab22d700-ce24-444d-9a07-2715bfc1641f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:02.845646 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-ab22d700-ce24-444d-9a07-2715bfc1641f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Getting quotas for project 1ccbb9b8d11b499cb9e84da27dd464e6. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:44:02.849534 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-ab22d700-ce24-444d-9a07-2715bfc1641f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Getting quotas for user 0e56ccc11ac043af908dbfe3a10c9a55 and project 1ccbb9b8d11b499cb9e84da27dd464e6. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:44:02.860596 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-ab22d700-ce24-444d-9a07-2715bfc1641f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Going to run 1 instances... {{(pid=123563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:44:02.862872 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-ab22d700-ce24-444d-9a07-2715bfc1641f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9826e12-1d0c-4a5a-9616-338520403016',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:44:02.915813 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-ab22d700-ce24-444d-9a07-2715bfc1641f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.844364 May 16 20:44:02.921212 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 402/801] 10.222.0.49 () {60 vars in 1146 bytes} [Mon May 16 20:44:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 20:44:02.927197 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-354c0bf2-e5c3-45be-a991-c9cfee093fc2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:02.927965 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-354c0bf2-e5c3-45be-a991-c9cfee093fc2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:03.000832 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-354c0bf2-e5c3-45be-a991-c9cfee093fc2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:03.011145 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-354c0bf2-e5c3-45be-a991-c9cfee093fc2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1238 microversion: 2.1 time: 0.087746 May 16 20:44:03.016599 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 400/802] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:02 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1238 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:03.048094 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-f175804f-fe05-4ae2-bdf8-12b1609689d0 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:03.049570 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-f175804f-fe05-4ae2-bdf8-12b1609689d0 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:03.058880 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f175804f-fe05-4ae2-bdf8-12b1609689d0 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:03.060127 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f175804f-fe05-4ae2-bdf8-12b1609689d0 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:03.061184 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f175804f-fe05-4ae2-bdf8-12b1609689d0 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:03.061686 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f175804f-fe05-4ae2-bdf8-12b1609689d0 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:03.234324 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f175804f-fe05-4ae2-bdf8-12b1609689d0 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:03.235310 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-2b7dbb80-cff3-4de8-b68e-e8403b008d30 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:03.235935 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-2b7dbb80-cff3-4de8-b68e-e8403b008d30 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 936a70bc-4d81-45d3-8266-58a369120074] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:03.243165 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-f175804f-fe05-4ae2-bdf8-12b1609689d0 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1259 microversion: 2.1 time: 0.199777 May 16 20:44:03.243666 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 403/803] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:03 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1259 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:03.243935 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2b7dbb80-cff3-4de8-b68e-e8403b008d30 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:03.244404 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2b7dbb80-cff3-4de8-b68e-e8403b008d30 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:03.245221 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2b7dbb80-cff3-4de8-b68e-e8403b008d30 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:03.245664 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2b7dbb80-cff3-4de8-b68e-e8403b008d30 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:03.407581 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2b7dbb80-cff3-4de8-b68e-e8403b008d30 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:03.416933 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-2b7dbb80-cff3-4de8-b68e-e8403b008d30 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074" status: 200 len: 1508 microversion: 2.1 time: 0.185378 May 16 20:44:03.417891 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 401/804] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:03 2022] GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074 => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:04.027745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-32a60059-d8f2-45ae-8098-5d449b5306c6 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:04.028475 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-32a60059-d8f2-45ae-8098-5d449b5306c6 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:04.035456 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-32a60059-d8f2-45ae-8098-5d449b5306c6 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:04.042540 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-32a60059-d8f2-45ae-8098-5d449b5306c6 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:04.044741 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-32a60059-d8f2-45ae-8098-5d449b5306c6 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:04.045228 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-32a60059-d8f2-45ae-8098-5d449b5306c6 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:04.197498 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-32a60059-d8f2-45ae-8098-5d449b5306c6 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:04.208467 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-32a60059-d8f2-45ae-8098-5d449b5306c6 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1298 microversion: 2.1 time: 0.184542 May 16 20:44:04.209130 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 404/805] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:04 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1298 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:04.263713 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-8d530704-a833-4455-81e3-964b36a9671a tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:04.265020 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-8d530704-a833-4455-81e3-964b36a9671a tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:04.272073 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-8d530704-a833-4455-81e3-964b36a9671a tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:04.272797 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-8d530704-a833-4455-81e3-964b36a9671a tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:04.274833 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-8d530704-a833-4455-81e3-964b36a9671a tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:04.275757 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-8d530704-a833-4455-81e3-964b36a9671a tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:04.493507 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-8d530704-a833-4455-81e3-964b36a9671a tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:04.501191 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-8d530704-a833-4455-81e3-964b36a9671a tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1259 microversion: 2.1 time: 0.244316 May 16 20:44:04.501776 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 402/806] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:04 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1259 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:05.225737 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7c059ac2-6571-48e8-9a59-6664b34341e8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:05.226636 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-7c059ac2-6571-48e8-9a59-6664b34341e8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:05.233089 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7c059ac2-6571-48e8-9a59-6664b34341e8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:05.233855 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7c059ac2-6571-48e8-9a59-6664b34341e8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:05.234704 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7c059ac2-6571-48e8-9a59-6664b34341e8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:05.235362 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7c059ac2-6571-48e8-9a59-6664b34341e8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:05.518672 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-80b4ab52-f1ab-4f96-8e16-9cedd6c6e861 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:05.519942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-80b4ab52-f1ab-4f96-8e16-9cedd6c6e861 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:05.527144 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-80b4ab52-f1ab-4f96-8e16-9cedd6c6e861 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:05.527693 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-80b4ab52-f1ab-4f96-8e16-9cedd6c6e861 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:05.528627 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-80b4ab52-f1ab-4f96-8e16-9cedd6c6e861 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:05.529142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-80b4ab52-f1ab-4f96-8e16-9cedd6c6e861 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:05.779650 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-7c059ac2-6571-48e8-9a59-6664b34341e8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:05.787708 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-7c059ac2-6571-48e8-9a59-6664b34341e8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1363 microversion: 2.1 time: 0.565865 May 16 20:44:05.788390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 405/807] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:05 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1363 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:05.802079 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-80b4ab52-f1ab-4f96-8e16-9cedd6c6e861 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:05.810602 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-80b4ab52-f1ab-4f96-8e16-9cedd6c6e861 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1259 microversion: 2.1 time: 0.295937 May 16 20:44:05.811375 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 403/808] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:05 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1259 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:06.096912 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-1ca644d7-bd16-4b11-8359-202da3f23e71 req-6672d780-7f66-4e4c-bf05-e5f2fc3d6d29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a733942d-a211-4c45-9fcf-8eab9293e040", "tag": "e9a3f0c7-3945-4332-8b0a-b5c43dc5c8a3"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:44:06.111098 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-1ca644d7-bd16-4b11-8359-202da3f23e71 req-6672d780-7f66-4e4c-bf05-e5f2fc3d6d29 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:06.111831 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-1ca644d7-bd16-4b11-8359-202da3f23e71 req-6672d780-7f66-4e4c-bf05-e5f2fc3d6d29 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:06.133457 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-1ca644d7-bd16-4b11-8359-202da3f23e71 req-6672d780-7f66-4e4c-bf05-e5f2fc3d6d29 service nova] Creating event network-changed:e9a3f0c7-3945-4332-8b0a-b5c43dc5c8a3 for instance a733942d-a211-4c45-9fcf-8eab9293e040 on hv-cinder-77703 May 16 20:44:06.142170 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-1ca644d7-bd16-4b11-8359-202da3f23e71 req-6672d780-7f66-4e4c-bf05-e5f2fc3d6d29 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050689 May 16 20:44:06.142785 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 406/809] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:44:06.805445 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-901caf9d-3d2e-4707-b34d-ff33ebb3309f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:06.806031 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-901caf9d-3d2e-4707-b34d-ff33ebb3309f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:06.813343 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-901caf9d-3d2e-4707-b34d-ff33ebb3309f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:06.813799 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-901caf9d-3d2e-4707-b34d-ff33ebb3309f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:06.814570 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-901caf9d-3d2e-4707-b34d-ff33ebb3309f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:06.815008 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-901caf9d-3d2e-4707-b34d-ff33ebb3309f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:06.828785 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-4038042b-b90f-4c84-ae16-6784b86353e7 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:06.829508 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-4038042b-b90f-4c84-ae16-6784b86353e7 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:06.836665 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4038042b-b90f-4c84-ae16-6784b86353e7 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:06.837112 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4038042b-b90f-4c84-ae16-6784b86353e7 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:06.837887 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4038042b-b90f-4c84-ae16-6784b86353e7 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:06.838315 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4038042b-b90f-4c84-ae16-6784b86353e7 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:07.049759 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-901caf9d-3d2e-4707-b34d-ff33ebb3309f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:07.054517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-4038042b-b90f-4c84-ae16-6784b86353e7 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:07.057676 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-901caf9d-3d2e-4707-b34d-ff33ebb3309f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1363 microversion: 2.1 time: 0.256172 May 16 20:44:07.058232 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 404/810] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:06 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:07.062790 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-4038042b-b90f-4c84-ae16-6784b86353e7 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1259 microversion: 2.1 time: 0.238999 May 16 20:44:07.063324 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 407/811] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:06 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1259 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:08.075885 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-49815e9f-ba39-430c-9090-bb4dcface2ca tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:08.076640 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-49815e9f-ba39-430c-9090-bb4dcface2ca tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:08.079571 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-97e75928-7b8d-4c05-b408-f741ee26f8de tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:08.080234 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-97e75928-7b8d-4c05-b408-f741ee26f8de tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:08.083850 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-49815e9f-ba39-430c-9090-bb4dcface2ca tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:08.084286 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-49815e9f-ba39-430c-9090-bb4dcface2ca tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:08.085198 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-49815e9f-ba39-430c-9090-bb4dcface2ca tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:08.085634 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-49815e9f-ba39-430c-9090-bb4dcface2ca tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:08.086851 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-97e75928-7b8d-4c05-b408-f741ee26f8de tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:08.087299 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-97e75928-7b8d-4c05-b408-f741ee26f8de tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:08.088354 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-97e75928-7b8d-4c05-b408-f741ee26f8de tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:08.089074 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-97e75928-7b8d-4c05-b408-f741ee26f8de tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:08.400062 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-49815e9f-ba39-430c-9090-bb4dcface2ca tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:08.407687 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-49815e9f-ba39-430c-9090-bb4dcface2ca tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1363 microversion: 2.1 time: 0.336132 May 16 20:44:08.408245 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 405/812] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:08 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1363 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:08.426897 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-97e75928-7b8d-4c05-b408-f741ee26f8de tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:08.435260 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-97e75928-7b8d-4c05-b408-f741ee26f8de tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1259 microversion: 2.1 time: 0.360026 May 16 20:44:08.435900 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 408/813] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:08 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1259 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:09.427740 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-47b5f3cf-73dc-424b-aec0-49120cf7582a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:09.428663 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-47b5f3cf-73dc-424b-aec0-49120cf7582a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:09.438740 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-47b5f3cf-73dc-424b-aec0-49120cf7582a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:09.439188 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-47b5f3cf-73dc-424b-aec0-49120cf7582a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:09.439965 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-47b5f3cf-73dc-424b-aec0-49120cf7582a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:09.440406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-47b5f3cf-73dc-424b-aec0-49120cf7582a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:09.452766 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-359defa2-e877-496a-8ae0-c94944966541 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:09.453362 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-359defa2-e877-496a-8ae0-c94944966541 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:09.460472 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-359defa2-e877-496a-8ae0-c94944966541 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:09.460960 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-359defa2-e877-496a-8ae0-c94944966541 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:09.461743 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-359defa2-e877-496a-8ae0-c94944966541 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:09.462184 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-359defa2-e877-496a-8ae0-c94944966541 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:09.642208 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-47b5f3cf-73dc-424b-aec0-49120cf7582a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:09.647091 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-359defa2-e877-496a-8ae0-c94944966541 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:09.651639 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-47b5f3cf-73dc-424b-aec0-49120cf7582a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1363 microversion: 2.1 time: 0.229435 May 16 20:44:09.652236 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 406/814] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:09 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:09.655198 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-359defa2-e877-496a-8ae0-c94944966541 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1259 microversion: 2.1 time: 0.206336 May 16 20:44:09.661608 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 409/815] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:09 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1259 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:10.668974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-93bb8368-e559-4f53-9f8e-017c3e5b88ea tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:10.669702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-93bb8368-e559-4f53-9f8e-017c3e5b88ea tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:10.674646 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-3479725c-56f1-4f94-af64-243315ab7d33 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:10.675678 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-3479725c-56f1-4f94-af64-243315ab7d33 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:10.676466 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-93bb8368-e559-4f53-9f8e-017c3e5b88ea tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:10.676920 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-93bb8368-e559-4f53-9f8e-017c3e5b88ea tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:10.677854 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-93bb8368-e559-4f53-9f8e-017c3e5b88ea tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:10.678296 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-93bb8368-e559-4f53-9f8e-017c3e5b88ea tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:10.682699 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3479725c-56f1-4f94-af64-243315ab7d33 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:10.683486 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3479725c-56f1-4f94-af64-243315ab7d33 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:10.684291 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3479725c-56f1-4f94-af64-243315ab7d33 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:10.685127 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3479725c-56f1-4f94-af64-243315ab7d33 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:10.883296 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-93bb8368-e559-4f53-9f8e-017c3e5b88ea tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:10.887405 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-3479725c-56f1-4f94-af64-243315ab7d33 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:10.894722 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-93bb8368-e559-4f53-9f8e-017c3e5b88ea tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1363 microversion: 2.1 time: 0.229531 May 16 20:44:10.895497 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 407/816] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:10 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:10.901022 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-3479725c-56f1-4f94-af64-243315ab7d33 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1259 microversion: 2.1 time: 0.225118 May 16 20:44:10.901702 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 410/817] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:10 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1259 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:11.134293 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-7232e678-79b8-482d-979f-3a1a86334786 req-0123eaca-8e3b-4021-a45d-c99cbe47c42a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4c11b0-f517-4783-99ec-8a010cb5dbb8", "name": "network-vif-plugged", "status": "completed", "tag": "29979fec-638a-4157-bbd7-3f1f941c944e"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:44:11.142817 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-7232e678-79b8-482d-979f-3a1a86334786 req-0123eaca-8e3b-4021-a45d-c99cbe47c42a service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:11.143358 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-7232e678-79b8-482d-979f-3a1a86334786 req-0123eaca-8e3b-4021-a45d-c99cbe47c42a service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:11.157129 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-7232e678-79b8-482d-979f-3a1a86334786 req-0123eaca-8e3b-4021-a45d-c99cbe47c42a service nova] Creating event network-vif-plugged:29979fec-638a-4157-bbd7-3f1f941c944e for instance cd4c11b0-f517-4783-99ec-8a010cb5dbb8 on hv-cinder-77703 May 16 20:44:11.162541 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-7232e678-79b8-482d-979f-3a1a86334786 req-0123eaca-8e3b-4021-a45d-c99cbe47c42a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032234 May 16 20:44:11.163125 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 408/818] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:44:11.913846 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-1e03aa48-6964-4b68-a256-95abe0557bfd tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:11.914505 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-1e03aa48-6964-4b68-a256-95abe0557bfd tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:11.920384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-52d6eca5-06d8-4c14-a33e-fa4e394b5327 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:11.921419 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-52d6eca5-06d8-4c14-a33e-fa4e394b5327 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:11.923086 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1e03aa48-6964-4b68-a256-95abe0557bfd tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:11.923662 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1e03aa48-6964-4b68-a256-95abe0557bfd tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:11.924674 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1e03aa48-6964-4b68-a256-95abe0557bfd tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:11.925291 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1e03aa48-6964-4b68-a256-95abe0557bfd tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:11.928929 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-52d6eca5-06d8-4c14-a33e-fa4e394b5327 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:11.929383 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-52d6eca5-06d8-4c14-a33e-fa4e394b5327 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:11.930165 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-52d6eca5-06d8-4c14-a33e-fa4e394b5327 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:11.930599 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-52d6eca5-06d8-4c14-a33e-fa4e394b5327 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:12.132602 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-1e03aa48-6964-4b68-a256-95abe0557bfd tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:12.138985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-52d6eca5-06d8-4c14-a33e-fa4e394b5327 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:12.142634 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-1e03aa48-6964-4b68-a256-95abe0557bfd tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1363 microversion: 2.1 time: 0.233862 May 16 20:44:12.143358 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 411/819] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:11 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:12.147892 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-52d6eca5-06d8-4c14-a33e-fa4e394b5327 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1259 microversion: 2.1 time: 0.233348 May 16 20:44:12.148459 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 409/820] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:11 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1259 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:13.160203 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-c4b9afa7-ca28-4f25-b50a-e7934bf135cf tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:13.161542 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-c4b9afa7-ca28-4f25-b50a-e7934bf135cf tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:13.164708 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-bf0f0ba4-598f-485d-b63d-f1676b5eed2f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:13.165323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-bf0f0ba4-598f-485d-b63d-f1676b5eed2f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:13.168757 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c4b9afa7-ca28-4f25-b50a-e7934bf135cf tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:13.169209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c4b9afa7-ca28-4f25-b50a-e7934bf135cf tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:13.169995 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c4b9afa7-ca28-4f25-b50a-e7934bf135cf tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:13.170500 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c4b9afa7-ca28-4f25-b50a-e7934bf135cf tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:13.171953 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bf0f0ba4-598f-485d-b63d-f1676b5eed2f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:13.172395 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bf0f0ba4-598f-485d-b63d-f1676b5eed2f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:13.173204 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bf0f0ba4-598f-485d-b63d-f1676b5eed2f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:13.173774 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bf0f0ba4-598f-485d-b63d-f1676b5eed2f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:13.371187 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-c4b9afa7-ca28-4f25-b50a-e7934bf135cf tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:13.372771 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-bf0f0ba4-598f-485d-b63d-f1676b5eed2f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:13.379597 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-c4b9afa7-ca28-4f25-b50a-e7934bf135cf tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1363 microversion: 2.1 time: 0.223885 May 16 20:44:13.380178 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 412/821] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:13 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:13.380702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-bf0f0ba4-598f-485d-b63d-f1676b5eed2f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1442 microversion: 2.1 time: 0.219849 May 16 20:44:13.381451 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 410/822] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:13 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1442 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:13.384512 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-ac2b8091-90f9-4469-8459-8bb2160270bb req-93deacce-3ecd-484c-b84f-d201a8699e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a733942d-a211-4c45-9fcf-8eab9293e040", "name": "network-vif-plugged", "status": "completed", "tag": "e9a3f0c7-3945-4332-8b0a-b5c43dc5c8a3"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:44:13.392675 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-ac2b8091-90f9-4469-8459-8bb2160270bb req-93deacce-3ecd-484c-b84f-d201a8699e20 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:13.393110 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-ac2b8091-90f9-4469-8459-8bb2160270bb req-93deacce-3ecd-484c-b84f-d201a8699e20 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:13.396852 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-3e01b892-e713-4f62-bd50-854f15272af8 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:13.397470 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-3e01b892-e713-4f62-bd50-854f15272af8 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:13.403769 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3e01b892-e713-4f62-bd50-854f15272af8 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:13.404250 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3e01b892-e713-4f62-bd50-854f15272af8 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:13.404535 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-ac2b8091-90f9-4469-8459-8bb2160270bb req-93deacce-3ecd-484c-b84f-d201a8699e20 service nova] Creating event network-vif-plugged:e9a3f0c7-3945-4332-8b0a-b5c43dc5c8a3 for instance a733942d-a211-4c45-9fcf-8eab9293e040 on hv-cinder-77703 May 16 20:44:13.405069 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3e01b892-e713-4f62-bd50-854f15272af8 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:13.405502 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3e01b892-e713-4f62-bd50-854f15272af8 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:13.409758 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-ac2b8091-90f9-4469-8459-8bb2160270bb req-93deacce-3ecd-484c-b84f-d201a8699e20 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028394 May 16 20:44:13.410765 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 413/823] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:44:13.539842 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3e01b892-e713-4f62-bd50-854f15272af8 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:13.547598 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-3e01b892-e713-4f62-bd50-854f15272af8 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1442 microversion: 2.1 time: 0.154657 May 16 20:44:13.548175 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 411/824] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:13 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1442 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:14.398228 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2757aed8-1231-4839-aa87-8790581f97c7 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:14.398873 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-2757aed8-1231-4839-aa87-8790581f97c7 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:14.405382 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2757aed8-1231-4839-aa87-8790581f97c7 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:14.405839 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2757aed8-1231-4839-aa87-8790581f97c7 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:14.406700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2757aed8-1231-4839-aa87-8790581f97c7 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:14.407062 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2757aed8-1231-4839-aa87-8790581f97c7 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:14.562257 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-2757aed8-1231-4839-aa87-8790581f97c7 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:14.570345 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-2757aed8-1231-4839-aa87-8790581f97c7 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1363 microversion: 2.1 time: 0.176920 May 16 20:44:14.570945 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 414/825] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:14 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:15.522498 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-50039cac-6608-4c75-9466-e6cc6a7f7bf9 req-9b0a3a2f-456a-4ef2-a1f7-ff4adaecd3fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd4c11b0-f517-4783-99ec-8a010cb5dbb8", "tag": "29979fec-638a-4157-bbd7-3f1f941c944e"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:44:15.532781 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-50039cac-6608-4c75-9466-e6cc6a7f7bf9 req-9b0a3a2f-456a-4ef2-a1f7-ff4adaecd3fb service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:15.533225 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-50039cac-6608-4c75-9466-e6cc6a7f7bf9 req-9b0a3a2f-456a-4ef2-a1f7-ff4adaecd3fb service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:15.545003 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-50039cac-6608-4c75-9466-e6cc6a7f7bf9 req-9b0a3a2f-456a-4ef2-a1f7-ff4adaecd3fb service nova] Creating event network-changed:29979fec-638a-4157-bbd7-3f1f941c944e for instance cd4c11b0-f517-4783-99ec-8a010cb5dbb8 on hv-cinder-77703 May 16 20:44:15.549885 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-50039cac-6608-4c75-9466-e6cc6a7f7bf9 req-9b0a3a2f-456a-4ef2-a1f7-ff4adaecd3fb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031189 May 16 20:44:15.550614 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 412/826] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:44:15.588955 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-4c640173-97fc-47c9-b194-688a38141db2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:15.588955 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-4c640173-97fc-47c9-b194-688a38141db2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:15.593395 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4c640173-97fc-47c9-b194-688a38141db2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:15.594060 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4c640173-97fc-47c9-b194-688a38141db2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:15.594993 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4c640173-97fc-47c9-b194-688a38141db2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:15.595600 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4c640173-97fc-47c9-b194-688a38141db2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:15.799023 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-4c640173-97fc-47c9-b194-688a38141db2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:15.806775 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-4c640173-97fc-47c9-b194-688a38141db2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1549 microversion: 2.1 time: 0.224049 May 16 20:44:15.812956 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 415/827] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:15 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1549 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:15.823820 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-0c463239-2e60-4860-9deb-9d5324056173 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:15.824402 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-0c463239-2e60-4860-9deb-9d5324056173 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:15.830573 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0c463239-2e60-4860-9deb-9d5324056173 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:15.831285 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0c463239-2e60-4860-9deb-9d5324056173 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:15.832249 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0c463239-2e60-4860-9deb-9d5324056173 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:15.832711 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-0c463239-2e60-4860-9deb-9d5324056173 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:15.943043 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-0c463239-2e60-4860-9deb-9d5324056173 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123363 May 16 20:44:15.944190 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 413/828] 10.222.0.49 () {58 vars in 1274 bytes} [Mon May 16 20:44:15 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:44:17.565280 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-079dca86-c13e-4a81-b030-14b981ddd88e req-e597d853-09ea-41b1-9e37-2553e0b122bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a733942d-a211-4c45-9fcf-8eab9293e040", "tag": "e9a3f0c7-3945-4332-8b0a-b5c43dc5c8a3"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:44:17.574045 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-079dca86-c13e-4a81-b030-14b981ddd88e req-e597d853-09ea-41b1-9e37-2553e0b122bb service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:17.574482 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-079dca86-c13e-4a81-b030-14b981ddd88e req-e597d853-09ea-41b1-9e37-2553e0b122bb service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:17.588091 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-079dca86-c13e-4a81-b030-14b981ddd88e req-e597d853-09ea-41b1-9e37-2553e0b122bb service nova] Creating event network-changed:e9a3f0c7-3945-4332-8b0a-b5c43dc5c8a3 for instance a733942d-a211-4c45-9fcf-8eab9293e040 on hv-cinder-77703 May 16 20:44:17.593215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-079dca86-c13e-4a81-b030-14b981ddd88e req-e597d853-09ea-41b1-9e37-2553e0b122bb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031629 May 16 20:44:17.593824 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 416/829] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:44:18.758367 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-45d5db13-7e58-4653-b444-9f84b3d855ee tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64816f0a-6cba-4310-b5b6-0c5ae195cb68", "device": "/dev/sdb"}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:44:18.759884 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-45d5db13-7e58-4653-b444-9f84b3d855ee tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 936a70bc-4d81-45d3-8266-58a369120074] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:18.766837 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-45d5db13-7e58-4653-b444-9f84b3d855ee tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:18.767315 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-45d5db13-7e58-4653-b444-9f84b3d855ee tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:18.768122 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-45d5db13-7e58-4653-b444-9f84b3d855ee tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:18.768591 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-45d5db13-7e58-4653-b444-9f84b3d855ee tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:19.014303 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-45d5db13-7e58-4653-b444-9f84b3d855ee tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "POST /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259823 May 16 20:44:19.015052 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 414/830] 10.222.0.49 () {60 vars in 1322 bytes} [Mon May 16 20:44:18 2022] POST /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:44:42.813266 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-bcfb3e03-ec37-4bc1-a155-edc64594a04f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:42.813819 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-bcfb3e03-ec37-4bc1-a155-edc64594a04f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 936a70bc-4d81-45d3-8266-58a369120074] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:42.820387 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-bcfb3e03-ec37-4bc1-a155-edc64594a04f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:42.820867 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-bcfb3e03-ec37-4bc1-a155-edc64594a04f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:42.821624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-bcfb3e03-ec37-4bc1-a155-edc64594a04f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:42.822049 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-bcfb3e03-ec37-4bc1-a155-edc64594a04f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:42.901851 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.objects.instance [None req-bcfb3e03-ec37-4bc1-a155-edc64594a04f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lazy-loading 'services' on Instance uuid 936a70bc-4d81-45d3-8266-58a369120074 {{(pid=123563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:44:42.975362 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-bcfb3e03-ec37-4bc1-a155-edc64594a04f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "DELETE /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074/os-volume_attachments/64816f0a-6cba-4310-b5b6-0c5ae195cb68" status: 202 len: 0 microversion: 2.1 time: 0.168248 May 16 20:44:42.975940 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 417/831] 10.222.0.49 () {58 vars in 1415 bytes} [Mon May 16 20:44:42 2022] DELETE /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074/os-volume_attachments/64816f0a-6cba-4310-b5b6-0c5ae195cb68 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:44:44.090923 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-585c339b-385a-4a51-a854-6bb1c4ceb668 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:44.091477 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-585c339b-385a-4a51-a854-6bb1c4ceb668 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 936a70bc-4d81-45d3-8266-58a369120074] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:44.098844 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-585c339b-385a-4a51-a854-6bb1c4ceb668 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:44.099285 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-585c339b-385a-4a51-a854-6bb1c4ceb668 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:44.100045 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-585c339b-385a-4a51-a854-6bb1c4ceb668 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:44.100465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-585c339b-385a-4a51-a854-6bb1c4ceb668 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:44.125353 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-585c339b-385a-4a51-a854-6bb1c4ceb668 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 936a70bc-4d81-45d3-8266-58a369120074] Going to try to terminate instance {{(pid=123564) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:44:44.207479 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-585c339b-385a-4a51-a854-6bb1c4ceb668 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "DELETE /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074" status: 204 len: 0 microversion: 2.1 time: 0.120483 May 16 20:44:44.208065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 415/832] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:44:44 2022] DELETE /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 20:44:44.217576 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-63daf877-21ed-479c-a7b2-ebe7c8cdc957 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:44.218279 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-63daf877-21ed-479c-a7b2-ebe7c8cdc957 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 936a70bc-4d81-45d3-8266-58a369120074] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:44.224746 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-63daf877-21ed-479c-a7b2-ebe7c8cdc957 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:44.225208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-63daf877-21ed-479c-a7b2-ebe7c8cdc957 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:44.225978 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-63daf877-21ed-479c-a7b2-ebe7c8cdc957 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:44.226414 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-63daf877-21ed-479c-a7b2-ebe7c8cdc957 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:44.380712 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-63daf877-21ed-479c-a7b2-ebe7c8cdc957 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:44.393323 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-63daf877-21ed-479c-a7b2-ebe7c8cdc957 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074" status: 200 len: 1514 microversion: 2.1 time: 0.180313 May 16 20:44:44.394150 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 418/833] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:44 2022] GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:44:45.418396 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-90084650-b8ef-4ccf-ae2c-a0adcd319209 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:45.419306 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-90084650-b8ef-4ccf-ae2c-a0adcd319209 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 936a70bc-4d81-45d3-8266-58a369120074] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:45.426116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-90084650-b8ef-4ccf-ae2c-a0adcd319209 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:45.426552 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-90084650-b8ef-4ccf-ae2c-a0adcd319209 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:45.427356 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-90084650-b8ef-4ccf-ae2c-a0adcd319209 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:45.427796 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-90084650-b8ef-4ccf-ae2c-a0adcd319209 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:45.569852 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-90084650-b8ef-4ccf-ae2c-a0adcd319209 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:45.579281 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-90084650-b8ef-4ccf-ae2c-a0adcd319209 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074" status: 200 len: 1514 microversion: 2.1 time: 0.168057 May 16 20:44:45.579829 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 416/834] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:45 2022] GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:46.466240 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-7212d768-26a2-42ef-93df-f309463f0031 req-8142576d-2c0f-483b-83f8-55ccd15cbc2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "936a70bc-4d81-45d3-8266-58a369120074", "name": "network-vif-deleted", "tag": "50e7f551-385d-4e2f-b318-b43340cbd079"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:44:46.474945 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-7212d768-26a2-42ef-93df-f309463f0031 req-8142576d-2c0f-483b-83f8-55ccd15cbc2c service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:46.475381 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-7212d768-26a2-42ef-93df-f309463f0031 req-8142576d-2c0f-483b-83f8-55ccd15cbc2c service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:46.486314 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-7212d768-26a2-42ef-93df-f309463f0031 req-8142576d-2c0f-483b-83f8-55ccd15cbc2c service nova] Creating event network-vif-deleted:50e7f551-385d-4e2f-b318-b43340cbd079 for instance 936a70bc-4d81-45d3-8266-58a369120074 on hv-cinder-77703 May 16 20:44:46.491144 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-7212d768-26a2-42ef-93df-f309463f0031 req-8142576d-2c0f-483b-83f8-55ccd15cbc2c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028721 May 16 20:44:46.492706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 419/835] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:44:46.597661 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-91561e38-299e-454b-b26d-c78a6aefa96d tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:46.598343 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-91561e38-299e-454b-b26d-c78a6aefa96d tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 936a70bc-4d81-45d3-8266-58a369120074] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:46.605355 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-91561e38-299e-454b-b26d-c78a6aefa96d tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:46.605804 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-91561e38-299e-454b-b26d-c78a6aefa96d tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:46.606583 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-91561e38-299e-454b-b26d-c78a6aefa96d tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:46.607013 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-91561e38-299e-454b-b26d-c78a6aefa96d tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:46.638168 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-91561e38-299e-454b-b26d-c78a6aefa96d tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:46.638533 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-91561e38-299e-454b-b26d-c78a6aefa96d tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:46.638984 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.objects.instance [None req-91561e38-299e-454b-b26d-c78a6aefa96d tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lazy-loading 'fault' on Instance uuid 936a70bc-4d81-45d3-8266-58a369120074 {{(pid=123564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:44:46.681660 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-91561e38-299e-454b-b26d-c78a6aefa96d tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:46.690038 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-91561e38-299e-454b-b26d-c78a6aefa96d tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074" status: 200 len: 1309 microversion: 2.1 time: 0.096972 May 16 20:44:46.690612 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 417/836] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:46 2022] GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:47.708558 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-9a574f59-cfac-4d4a-b4b9-2aa0ceedcd6f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:47.709251 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-9a574f59-cfac-4d4a-b4b9-2aa0ceedcd6f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 936a70bc-4d81-45d3-8266-58a369120074] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:47.715859 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9a574f59-cfac-4d4a-b4b9-2aa0ceedcd6f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:47.716304 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9a574f59-cfac-4d4a-b4b9-2aa0ceedcd6f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:47.717109 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9a574f59-cfac-4d4a-b4b9-2aa0ceedcd6f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:47.717536 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-9a574f59-cfac-4d4a-b4b9-2aa0ceedcd6f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:47.731009 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-9a574f59-cfac-4d4a-b4b9-2aa0ceedcd6f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] HTTP exception thrown: Instance 936a70bc-4d81-45d3-8266-58a369120074 could not be found. May 16 20:44:47.732764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-9a574f59-cfac-4d4a-b4b9-2aa0ceedcd6f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Request method failure captured: May 16 20:44:47.732764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074 HTTP/1.1 May 16 20:44:47.732764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:44:47.732764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:44:47.732764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:44:47.732764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:44:47.732764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:44:47.732764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:44:47.732764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:44:47.732764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:44:47.732764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigreGKaxX25B34lq585Vl3cwTtsThedysnHGoDkHammzuveAVlfbrWWajzrpvBJSF_VRLaRT62psIzQBKzTBhLSEZX8sFEo34jrLBsPxK9IXe1QwXaKvI8dkvxkU5fb2UgB2Ma9sJFgT3nmXpzLqZuEcI66pg3krp1ljxO-LEzS9pqwA May 16 20:44:47.732764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:44:47.732764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:44:47.732764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:44:47.732764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:44:47.732764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:44:47.732764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:44:47.732764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 579a6c29476643ed997c798ed64bc409 May 16 20:44:47.732764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-VolumesSnapshotTestJSON-599123165 May 16 20:44:47.732764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:44:47.732764 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:44:47.734445 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_579a6c29476643ed997c798ed64bc409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/579a6c29476643ed997c798ed64bc409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/579a6c29476643ed997c798ed64bc409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/579a6c29476643ed997c798ed64bc409"}]}] May 16 20:44:47.734445 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-VolumesSnapshotTestJSON-599123165 May 16 20:44:47.734445 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 579a6c29476643ed997c798ed64bc409 May 16 20:44:47.734445 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-599123165 May 16 20:44:47.734445 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-VolumesSnapshotTestJSON-599123165-project May 16 20:44:47.734445 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:44:47.734445 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:44:47.734445 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: 28b413f53d6e404fa3d613d21d07afc7 May 16 20:44:47.734445 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-VolumesSnapshotTestJSON-599123165-project May 16 20:44:47.734445 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: > May 16 20:44:47.734445 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Instance 936a70bc-4d81-45d3-8266-58a369120074 could not be found. May 16 20:44:47.734445 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': '936a70bc-4d81-45d3-8266-58a369120074'} May 16 20:44:47.735478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:44:47.735478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:44:47.735478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:44:47.735478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:44:47.735478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:44:47.735478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:44:47.735478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:44:47.735478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:44:47.735478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:44:47.735478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:44:47.735478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 936a70bc-4d81-45d3-8266-58a369120074 could not be found. May 16 20:44:47.735478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:44:47.735478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:44:47.735478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:44:47.735478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:44:47.735478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:44:47.735478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:44:47.735478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:44:47.735478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:44:47.735478 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:44:47.737171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:44:47.737171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:44:47.737171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:44:47.737171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:44:47.737171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:44:47.737171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:44:47.737171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:44:47.737171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 936a70bc-4d81-45d3-8266-58a369120074 could not be found. May 16 20:44:47.737171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:44:47.737171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:44:47.737171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:44:47.737171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:44:47.737171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:44:47.737171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:44:47.737171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:44:47.737171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:44:47.737171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 936a70bc-4d81-45d3-8266-58a369120074 could not be found. May 16 20:44:47.737171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:44:47.738608 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-9a574f59-cfac-4d4a-b4b9-2aa0ceedcd6f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Returning 404 to user: Instance 936a70bc-4d81-45d3-8266-58a369120074 could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:44:47.738608 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-9a574f59-cfac-4d4a-b4b9-2aa0ceedcd6f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074" status: 404 len: 111 microversion: 2.1 time: 0.030388 May 16 20:44:47.738608 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 420/837] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:47 2022] GET /compute/v2.1/servers/936a70bc-4d81-45d3-8266-58a369120074 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:44:57.651541 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-804ce58c-70ec-4a80-a227-50d80b179ed9 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1510663903", "imageRef": "f9826e12-1d0c-4a5a-9616-338520403016", "flavorRef": "452", "networks": [{"uuid": "e1a25354-c73e-4477-9767-fb33921f0f33"}]}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:44:57.703946 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.network.neutron [None req-804ce58c-70ec-4a80-a227-50d80b179ed9 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] validate_networks() for [('e1a25354-c73e-4477-9767-fb33921f0f33', None, None, None, None, None)] {{(pid=123564) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:44:58.054810 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-804ce58c-70ec-4a80-a227-50d80b179ed9 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Flavor limits 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:44:58.055409 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-804ce58c-70ec-4a80-a227-50d80b179ed9 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Image limits 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:44:58.056117 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-804ce58c-70ec-4a80-a227-50d80b179ed9 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Flavor pref 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:44:58.056798 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-804ce58c-70ec-4a80-a227-50d80b179ed9 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Image pref 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:44:58.057443 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-804ce58c-70ec-4a80-a227-50d80b179ed9 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:44:58.072542 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-804ce58c-70ec-4a80-a227-50d80b179ed9 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:58.073053 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-804ce58c-70ec-4a80-a227-50d80b179ed9 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:58.074280 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-804ce58c-70ec-4a80-a227-50d80b179ed9 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:58.074957 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-804ce58c-70ec-4a80-a227-50d80b179ed9 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:58.093193 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-804ce58c-70ec-4a80-a227-50d80b179ed9 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Getting quotas for project 579a6c29476643ed997c798ed64bc409. Resources: {'cores', 'ram', 'instances'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:44:58.097221 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-804ce58c-70ec-4a80-a227-50d80b179ed9 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Getting quotas for user 28b413f53d6e404fa3d613d21d07afc7 and project 579a6c29476643ed997c798ed64bc409. Resources: {'cores', 'ram', 'instances'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:44:58.108213 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-804ce58c-70ec-4a80-a227-50d80b179ed9 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Going to run 1 instances... {{(pid=123564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:44:58.110680 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-804ce58c-70ec-4a80-a227-50d80b179ed9 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 873a9d69-1266-4bcc-9b5a-336b903ff358] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9826e12-1d0c-4a5a-9616-338520403016',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:44:58.155705 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-804ce58c-70ec-4a80-a227-50d80b179ed9 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508046 May 16 20:44:58.156358 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 418/838] 10.222.0.49 () {60 vars in 1146 bytes} [Mon May 16 20:44:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 20:44:58.166177 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-d7ece272-7984-4489-9e9c-4d33abba8f0b tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:58.166919 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-d7ece272-7984-4489-9e9c-4d33abba8f0b tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 873a9d69-1266-4bcc-9b5a-336b903ff358] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:58.221126 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d7ece272-7984-4489-9e9c-4d33abba8f0b tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:58.229024 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-d7ece272-7984-4489-9e9c-4d33abba8f0b tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358" status: 200 len: 1219 microversion: 2.1 time: 0.066633 May 16 20:44:58.229551 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 421/839] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:58 2022] GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:44:59.248050 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-bc5c4356-ba39-4b2b-b459-e27b7a6e5772 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:44:59.248688 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-bc5c4356-ba39-4b2b-b459-e27b7a6e5772 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 873a9d69-1266-4bcc-9b5a-336b903ff358] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:44:59.256006 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bc5c4356-ba39-4b2b-b459-e27b7a6e5772 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:59.256477 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bc5c4356-ba39-4b2b-b459-e27b7a6e5772 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:59.257240 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bc5c4356-ba39-4b2b-b459-e27b7a6e5772 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:44:59.257677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bc5c4356-ba39-4b2b-b459-e27b7a6e5772 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:44:59.323594 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-bc5c4356-ba39-4b2b-b459-e27b7a6e5772 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:44:59.331616 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-bc5c4356-ba39-4b2b-b459-e27b7a6e5772 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358" status: 200 len: 1271 microversion: 2.1 time: 0.088162 May 16 20:44:59.332189 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 419/840] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:44:59 2022] GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:00.134351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-441ac9ad-c491-4e6a-88ef-4ffb2b94e48b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2077517517", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1538528591", "security_groups": [{"name": "tempest-secgroup-smoke-2122782084"}], "block_device_mapping_v2": [{"uuid": "9a5940f5-e552-4dad-8baf-6cb3cc5020a4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f4ce36dc-b331-48ab-b5b5-0de5501adc95"}]}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:45:00.286897 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.network.neutron [None req-441ac9ad-c491-4e6a-88ef-4ffb2b94e48b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] validate_networks() for [('f4ce36dc-b331-48ab-b5b5-0de5501adc95', None, None, None, None, None)] {{(pid=123563) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:45:00.349318 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-ab3525df-0b6d-4966-a506-03fd8ad7adde tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:00.349943 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-ab3525df-0b6d-4966-a506-03fd8ad7adde tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 873a9d69-1266-4bcc-9b5a-336b903ff358] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:00.356880 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ab3525df-0b6d-4966-a506-03fd8ad7adde tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:00.357353 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ab3525df-0b6d-4966-a506-03fd8ad7adde tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:00.358129 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ab3525df-0b6d-4966-a506-03fd8ad7adde tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:00.358555 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ab3525df-0b6d-4966-a506-03fd8ad7adde tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:00.904862 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-ab3525df-0b6d-4966-a506-03fd8ad7adde tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:00.913913 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-ab3525df-0b6d-4966-a506-03fd8ad7adde tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358" status: 200 len: 1319 microversion: 2.1 time: 0.568429 May 16 20:45:00.914756 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 420/841] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:00 2022] GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358 => generated 1319 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:45:00.919996 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e69cbc06-9b30-494c-a680-bc0927074819 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:00.920738 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-e69cbc06-9b30-494c-a680-bc0927074819 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:00.927253 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e69cbc06-9b30-494c-a680-bc0927074819 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:00.927711 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e69cbc06-9b30-494c-a680-bc0927074819 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:00.928535 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e69cbc06-9b30-494c-a680-bc0927074819 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:00.928994 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e69cbc06-9b30-494c-a680-bc0927074819 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:00.954845 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-e69cbc06-9b30-494c-a680-bc0927074819 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040/ips" status: 200 len: 146 microversion: 2.1 time: 0.038641 May 16 20:45:00.956205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 421/842] 10.222.0.49 () {58 vars in 1247 bytes} [Mon May 16 20:45:00 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:45:01.326910 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-441ac9ad-c491-4e6a-88ef-4ffb2b94e48b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Flavor limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:45:01.327419 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-441ac9ad-c491-4e6a-88ef-4ffb2b94e48b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Image limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:45:01.328474 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-441ac9ad-c491-4e6a-88ef-4ffb2b94e48b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Flavor pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:45:01.328897 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-441ac9ad-c491-4e6a-88ef-4ffb2b94e48b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Image pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:45:01.329311 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-441ac9ad-c491-4e6a-88ef-4ffb2b94e48b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:45:01.338786 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-441ac9ad-c491-4e6a-88ef-4ffb2b94e48b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:01.339235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-441ac9ad-c491-4e6a-88ef-4ffb2b94e48b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:01.340077 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-441ac9ad-c491-4e6a-88ef-4ffb2b94e48b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:01.340589 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-441ac9ad-c491-4e6a-88ef-4ffb2b94e48b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:01.357101 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-441ac9ad-c491-4e6a-88ef-4ffb2b94e48b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Getting quotas for project 710ecde5160640149c693e0c2b0b0354. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:45:01.361059 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-441ac9ad-c491-4e6a-88ef-4ffb2b94e48b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Getting quotas for user 6fa431ce09e44b85b61af972bbce2ed4 and project 710ecde5160640149c693e0c2b0b0354. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:45:01.422795 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-441ac9ad-c491-4e6a-88ef-4ffb2b94e48b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Going to run 1 instances... {{(pid=123563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:45:01.424928 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-441ac9ad-c491-4e6a-88ef-4ffb2b94e48b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9a5940f5-e552-4dad-8baf-6cb3cc5020a4',volume_size=None,volume_type=None)] {{(pid=123563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:45:01.529357 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-35ef3cdd-d438-4d37-a582-e808d956ebf8 req-c42154e1-4ca6-4709-857a-94e73f148f30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "873a9d69-1266-4bcc-9b5a-336b903ff358", "tag": "201b5a31-be5b-4eff-8be6-2ce2363277d7"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:45:01.541584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-35ef3cdd-d438-4d37-a582-e808d956ebf8 req-c42154e1-4ca6-4709-857a-94e73f148f30 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:01.542329 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-35ef3cdd-d438-4d37-a582-e808d956ebf8 req-c42154e1-4ca6-4709-857a-94e73f148f30 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:01.556475 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-35ef3cdd-d438-4d37-a582-e808d956ebf8 req-c42154e1-4ca6-4709-857a-94e73f148f30 service nova] Creating event network-changed:201b5a31-be5b-4eff-8be6-2ce2363277d7 for instance 873a9d69-1266-4bcc-9b5a-336b903ff358 on hv-cinder-77703 May 16 20:45:01.561882 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-35ef3cdd-d438-4d37-a582-e808d956ebf8 req-c42154e1-4ca6-4709-857a-94e73f148f30 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036714 May 16 20:45:01.563153 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 422/843] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:45:01.569983 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-441ac9ad-c491-4e6a-88ef-4ffb2b94e48b tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.439565 May 16 20:45:01.570640 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 422/844] 10.222.0.49 () {60 vars in 1146 bytes} [Mon May 16 20:45:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 20:45:01.581882 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6895a024-8310-4bba-b3b1-e1b7a6a97a49 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:01.582784 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-6895a024-8310-4bba-b3b1-e1b7a6a97a49 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:01.669208 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6895a024-8310-4bba-b3b1-e1b7a6a97a49 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:01.675940 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-6895a024-8310-4bba-b3b1-e1b7a6a97a49 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f" status: 200 len: 1095 microversion: 2.1 time: 0.098854 May 16 20:45:01.676794 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 423/845] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:01 2022] GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f => generated 1095 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:45:01.933017 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-1a886e53-df9a-4fcf-8ae5-df2cfcce2bdb tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:01.933847 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-1a886e53-df9a-4fcf-8ae5-df2cfcce2bdb tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 873a9d69-1266-4bcc-9b5a-336b903ff358] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:01.942527 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1a886e53-df9a-4fcf-8ae5-df2cfcce2bdb tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:01.943221 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1a886e53-df9a-4fcf-8ae5-df2cfcce2bdb tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:01.944320 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1a886e53-df9a-4fcf-8ae5-df2cfcce2bdb tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:01.945152 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1a886e53-df9a-4fcf-8ae5-df2cfcce2bdb tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:02.244008 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-1a886e53-df9a-4fcf-8ae5-df2cfcce2bdb tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:02.251480 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-1a886e53-df9a-4fcf-8ae5-df2cfcce2bdb tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358" status: 200 len: 1319 microversion: 2.1 time: 0.323933 May 16 20:45:02.252050 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 423/846] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:01 2022] GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358 => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:02.693636 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-27de0aa5-2e02-4a15-91e7-45dfff2afda4 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:02.694379 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-27de0aa5-2e02-4a15-91e7-45dfff2afda4 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:02.701980 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-27de0aa5-2e02-4a15-91e7-45dfff2afda4 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:02.702431 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-27de0aa5-2e02-4a15-91e7-45dfff2afda4 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:02.703253 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-27de0aa5-2e02-4a15-91e7-45dfff2afda4 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:02.703683 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-27de0aa5-2e02-4a15-91e7-45dfff2afda4 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:02.776753 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-27de0aa5-2e02-4a15-91e7-45dfff2afda4 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:02.788120 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-27de0aa5-2e02-4a15-91e7-45dfff2afda4 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f" status: 200 len: 1201 microversion: 2.1 time: 0.098140 May 16 20:45:02.788944 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 424/847] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:02 2022] GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f => generated 1201 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:03.031198 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2fedc9c0-4540-4009-a606-9b6e9eb5abb1 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c16d356-3f5e-4f7f-b3c5-e3b73662b9d3"}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:45:03.032267 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-2fedc9c0-4540-4009-a606-9b6e9eb5abb1 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:03.038540 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2fedc9c0-4540-4009-a606-9b6e9eb5abb1 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:03.038968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2fedc9c0-4540-4009-a606-9b6e9eb5abb1 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:03.039766 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2fedc9c0-4540-4009-a606-9b6e9eb5abb1 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:03.040208 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2fedc9c0-4540-4009-a606-9b6e9eb5abb1 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:03.270153 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-02daf167-2442-48d8-a15a-6c76d3a9fe4f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:03.270669 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-02daf167-2442-48d8-a15a-6c76d3a9fe4f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 873a9d69-1266-4bcc-9b5a-336b903ff358] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:03.277513 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-02daf167-2442-48d8-a15a-6c76d3a9fe4f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:03.277964 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-02daf167-2442-48d8-a15a-6c76d3a9fe4f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:03.280242 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-02daf167-2442-48d8-a15a-6c76d3a9fe4f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:03.280862 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-02daf167-2442-48d8-a15a-6c76d3a9fe4f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:03.459567 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-2fedc9c0-4540-4009-a606-9b6e9eb5abb1 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "POST /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.432303 May 16 20:45:03.461461 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 424/848] 10.222.0.49 () {60 vars in 1322 bytes} [Mon May 16 20:45:03 2022] POST /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040/os-volume_attachments => generated 194 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:45:03.603115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-02daf167-2442-48d8-a15a-6c76d3a9fe4f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:03.610499 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-02daf167-2442-48d8-a15a-6c76d3a9fe4f tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358" status: 200 len: 1319 microversion: 2.1 time: 0.344323 May 16 20:45:03.611116 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 425/849] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:03 2022] GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:03.806319 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-c59d29ab-bf18-4ea1-9fc4-2daec3672ee8 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:03.807163 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-c59d29ab-bf18-4ea1-9fc4-2daec3672ee8 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:03.815608 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c59d29ab-bf18-4ea1-9fc4-2daec3672ee8 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:03.816084 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c59d29ab-bf18-4ea1-9fc4-2daec3672ee8 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:03.817055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c59d29ab-bf18-4ea1-9fc4-2daec3672ee8 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:03.817680 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c59d29ab-bf18-4ea1-9fc4-2daec3672ee8 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:03.934797 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-c59d29ab-bf18-4ea1-9fc4-2daec3672ee8 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:03.947700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-c59d29ab-bf18-4ea1-9fc4-2daec3672ee8 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f" status: 200 len: 1211 microversion: 2.1 time: 0.145588 May 16 20:45:03.950619 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 425/850] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:03 2022] GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f => generated 1211 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:04.627344 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-675a9367-de02-4e4e-853d-d71fe19a0893 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:04.627880 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-675a9367-de02-4e4e-853d-d71fe19a0893 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 873a9d69-1266-4bcc-9b5a-336b903ff358] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:04.634306 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-675a9367-de02-4e4e-853d-d71fe19a0893 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:04.634745 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-675a9367-de02-4e4e-853d-d71fe19a0893 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:04.635540 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-675a9367-de02-4e4e-853d-d71fe19a0893 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:04.636602 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-675a9367-de02-4e4e-853d-d71fe19a0893 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:04.967695 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-d1334e94-71b2-4445-8f74-3761803c98e0 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:04.968312 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-d1334e94-71b2-4445-8f74-3761803c98e0 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:04.975560 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d1334e94-71b2-4445-8f74-3761803c98e0 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:04.976025 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d1334e94-71b2-4445-8f74-3761803c98e0 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:04.976866 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d1334e94-71b2-4445-8f74-3761803c98e0 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:04.977305 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d1334e94-71b2-4445-8f74-3761803c98e0 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:05.197443 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-675a9367-de02-4e4e-853d-d71fe19a0893 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:05.209896 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-675a9367-de02-4e4e-853d-d71fe19a0893 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358" status: 200 len: 1319 microversion: 2.1 time: 0.586555 May 16 20:45:05.221142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 426/851] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:04 2022] GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358 => generated 1319 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:05.225556 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d1334e94-71b2-4445-8f74-3761803c98e0 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:05.233017 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-d1334e94-71b2-4445-8f74-3761803c98e0 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f" status: 200 len: 1267 microversion: 2.1 time: 0.269319 May 16 20:45:05.233596 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 426/852] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:04 2022] GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f => generated 1267 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:05.501549 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-d358a8f6-3b75-4d1b-a9c1-13152e87538f req-90a554b9-6162-4e01-869f-3382a968ae0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "117d359a-7af9-46f0-bffb-d12ad46a929f", "tag": "996a4b17-c006-48b9-b68b-6329ea3a6c7a"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:45:05.512956 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-d358a8f6-3b75-4d1b-a9c1-13152e87538f req-90a554b9-6162-4e01-869f-3382a968ae0e service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:05.513669 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-d358a8f6-3b75-4d1b-a9c1-13152e87538f req-90a554b9-6162-4e01-869f-3382a968ae0e service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:05.529842 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-d358a8f6-3b75-4d1b-a9c1-13152e87538f req-90a554b9-6162-4e01-869f-3382a968ae0e service nova] Creating event network-changed:996a4b17-c006-48b9-b68b-6329ea3a6c7a for instance 117d359a-7af9-46f0-bffb-d12ad46a929f on hv-cinder-77703 May 16 20:45:05.537741 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-d358a8f6-3b75-4d1b-a9c1-13152e87538f req-90a554b9-6162-4e01-869f-3382a968ae0e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040080 May 16 20:45:05.538422 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 427/853] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:45:06.228252 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0624c422-0715-419d-a298-480ce658614e tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:06.229052 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0624c422-0715-419d-a298-480ce658614e tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 873a9d69-1266-4bcc-9b5a-336b903ff358] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:06.236745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0624c422-0715-419d-a298-480ce658614e tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:06.237189 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0624c422-0715-419d-a298-480ce658614e tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:06.237965 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0624c422-0715-419d-a298-480ce658614e tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:06.238460 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0624c422-0715-419d-a298-480ce658614e tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:06.252721 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-816c80d0-137d-4bbf-9c30-3927f4e9766c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:06.253559 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-816c80d0-137d-4bbf-9c30-3927f4e9766c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:06.260683 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-816c80d0-137d-4bbf-9c30-3927f4e9766c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:06.261234 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-816c80d0-137d-4bbf-9c30-3927f4e9766c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:06.262098 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-816c80d0-137d-4bbf-9c30-3927f4e9766c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:06.262606 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-816c80d0-137d-4bbf-9c30-3927f4e9766c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:06.532726 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-0624c422-0715-419d-a298-480ce658614e tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:06.538152 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-816c80d0-137d-4bbf-9c30-3927f4e9766c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:06.541540 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0624c422-0715-419d-a298-480ce658614e tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358" status: 200 len: 1319 microversion: 2.1 time: 0.317931 May 16 20:45:06.542556 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 427/854] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:06 2022] GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358 => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:06.546203 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-816c80d0-137d-4bbf-9c30-3927f4e9766c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f" status: 200 len: 1267 microversion: 2.1 time: 0.298942 May 16 20:45:06.546884 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 428/855] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:06 2022] GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f => generated 1267 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:07.135492 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-3d756e01-9c92-40fe-b049-f0b33dbbd4d1 req-9c55d697-5369-439a-bb60-f72f24e74d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873a9d69-1266-4bcc-9b5a-336b903ff358", "name": "network-vif-plugged", "status": "completed", "tag": "201b5a31-be5b-4eff-8be6-2ce2363277d7"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:45:07.145833 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-3d756e01-9c92-40fe-b049-f0b33dbbd4d1 req-9c55d697-5369-439a-bb60-f72f24e74d1b service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:07.146292 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-3d756e01-9c92-40fe-b049-f0b33dbbd4d1 req-9c55d697-5369-439a-bb60-f72f24e74d1b service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:07.158415 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-3d756e01-9c92-40fe-b049-f0b33dbbd4d1 req-9c55d697-5369-439a-bb60-f72f24e74d1b service nova] Creating event network-vif-plugged:201b5a31-be5b-4eff-8be6-2ce2363277d7 for instance 873a9d69-1266-4bcc-9b5a-336b903ff358 on hv-cinder-77703 May 16 20:45:07.164604 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-3d756e01-9c92-40fe-b049-f0b33dbbd4d1 req-9c55d697-5369-439a-bb60-f72f24e74d1b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032764 May 16 20:45:07.165465 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 428/856] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:45:07.563119 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-f07db672-1ef5-4a26-9273-59a3f1000d27 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:07.563781 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-f07db672-1ef5-4a26-9273-59a3f1000d27 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 873a9d69-1266-4bcc-9b5a-336b903ff358] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:07.570325 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-d9504d5c-1f7e-4d56-8420-1311d04aae1c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:07.571103 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-d9504d5c-1f7e-4d56-8420-1311d04aae1c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:07.571373 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f07db672-1ef5-4a26-9273-59a3f1000d27 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:07.571796 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f07db672-1ef5-4a26-9273-59a3f1000d27 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:07.572701 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f07db672-1ef5-4a26-9273-59a3f1000d27 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:07.573184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f07db672-1ef5-4a26-9273-59a3f1000d27 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:07.578822 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d9504d5c-1f7e-4d56-8420-1311d04aae1c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:07.579340 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d9504d5c-1f7e-4d56-8420-1311d04aae1c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:07.580207 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d9504d5c-1f7e-4d56-8420-1311d04aae1c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:07.580733 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d9504d5c-1f7e-4d56-8420-1311d04aae1c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:07.762097 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-f07db672-1ef5-4a26-9273-59a3f1000d27 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:07.769830 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-f07db672-1ef5-4a26-9273-59a3f1000d27 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358" status: 200 len: 1319 microversion: 2.1 time: 0.213710 May 16 20:45:07.770386 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 429/857] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:07 2022] GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:07.770545 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d9504d5c-1f7e-4d56-8420-1311d04aae1c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:07.777958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-d9504d5c-1f7e-4d56-8420-1311d04aae1c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f" status: 200 len: 1267 microversion: 2.1 time: 0.212345 May 16 20:45:07.778549 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 429/858] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:07 2022] GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:08.786763 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-f0991d73-3cc5-4c2b-8039-faf8eb2ee278 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:08.787413 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-f0991d73-3cc5-4c2b-8039-faf8eb2ee278 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 873a9d69-1266-4bcc-9b5a-336b903ff358] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:08.794489 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f0991d73-3cc5-4c2b-8039-faf8eb2ee278 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:08.794853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f0991d73-3cc5-4c2b-8039-faf8eb2ee278 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:08.795381 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-fc6eee6d-967f-4dca-998f-1d49be78acba tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:08.795832 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f0991d73-3cc5-4c2b-8039-faf8eb2ee278 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:08.796046 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-fc6eee6d-967f-4dca-998f-1d49be78acba tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:08.796179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f0991d73-3cc5-4c2b-8039-faf8eb2ee278 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:08.803497 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fc6eee6d-967f-4dca-998f-1d49be78acba tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:08.803937 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fc6eee6d-967f-4dca-998f-1d49be78acba tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:08.804798 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fc6eee6d-967f-4dca-998f-1d49be78acba tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:08.805296 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fc6eee6d-967f-4dca-998f-1d49be78acba tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:08.995733 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-fc6eee6d-967f-4dca-998f-1d49be78acba tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:08.999061 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-f0991d73-3cc5-4c2b-8039-faf8eb2ee278 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:09.003511 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-fc6eee6d-967f-4dca-998f-1d49be78acba tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f" status: 200 len: 1267 microversion: 2.1 time: 0.212195 May 16 20:45:09.004059 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 430/859] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:08 2022] GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:09.006790 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-f0991d73-3cc5-4c2b-8039-faf8eb2ee278 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358" status: 200 len: 1508 microversion: 2.1 time: 0.224230 May 16 20:45:09.007351 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 430/860] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:08 2022] GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358 => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:09.023033 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-008c8925-ee87-419c-ae2c-21245df4aa2d tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c0ebc20-8e9a-410b-a7b5-5e408801838e", "device": "/dev/sdb"}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:45:09.024615 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-008c8925-ee87-419c-ae2c-21245df4aa2d tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 873a9d69-1266-4bcc-9b5a-336b903ff358] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:09.030699 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-008c8925-ee87-419c-ae2c-21245df4aa2d tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:09.031152 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-008c8925-ee87-419c-ae2c-21245df4aa2d tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:09.032017 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-008c8925-ee87-419c-ae2c-21245df4aa2d tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:09.032463 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-008c8925-ee87-419c-ae2c-21245df4aa2d tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:09.285069 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-008c8925-ee87-419c-ae2c-21245df4aa2d tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "POST /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265644 May 16 20:45:09.285779 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 431/861] 10.222.0.49 () {60 vars in 1322 bytes} [Mon May 16 20:45:09 2022] POST /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:45:09.813135 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 20:45:09.814646 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Mon May 16 20:45:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 20:45:10.024895 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-2e298b60-a322-4084-8090-84141f1ab478 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:10.025791 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-2e298b60-a322-4084-8090-84141f1ab478 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:10.036945 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2e298b60-a322-4084-8090-84141f1ab478 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:10.037699 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2e298b60-a322-4084-8090-84141f1ab478 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:10.038991 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2e298b60-a322-4084-8090-84141f1ab478 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:10.039687 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2e298b60-a322-4084-8090-84141f1ab478 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:10.184600 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2e298b60-a322-4084-8090-84141f1ab478 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:10.193697 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-2e298b60-a322-4084-8090-84141f1ab478 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f" status: 200 len: 1267 microversion: 2.1 time: 0.175458 May 16 20:45:10.194926 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 431/862] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:10 2022] GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:10.999638 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-28189026-e6ac-40c1-aa5d-3ea595be675b tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:45:11.006219 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-28189026-e6ac-40c1-aa5d-3ea595be675b tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:11.006670 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-28189026-e6ac-40c1-aa5d-3ea595be675b tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:11.065665 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-28189026-e6ac-40c1-aa5d-3ea595be675b tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Going to try to stop instance {{(pid=123563) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 16 20:45:11.111069 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-28189026-e6ac-40c1-aa5d-3ea595be675b tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "POST /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040/action" status: 202 len: 0 microversion: 2.1 time: 0.116063 May 16 20:45:11.111667 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 432/863] 10.222.0.49 () {60 vars in 1277 bytes} [Mon May 16 20:45:10 2022] POST /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:45:11.119746 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-316632ab-a194-4c6a-98c3-355bdf129f0a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:11.120489 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-316632ab-a194-4c6a-98c3-355bdf129f0a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:11.127074 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-316632ab-a194-4c6a-98c3-355bdf129f0a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:11.127524 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-316632ab-a194-4c6a-98c3-355bdf129f0a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:11.128365 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-316632ab-a194-4c6a-98c3-355bdf129f0a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:11.128825 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-316632ab-a194-4c6a-98c3-355bdf129f0a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:11.213300 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7f635234-a825-49bc-80e1-12c86d04ddfa tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:11.214005 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-7f635234-a825-49bc-80e1-12c86d04ddfa tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:11.220618 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7f635234-a825-49bc-80e1-12c86d04ddfa tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:11.221099 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7f635234-a825-49bc-80e1-12c86d04ddfa tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:11.221835 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7f635234-a825-49bc-80e1-12c86d04ddfa tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:11.222267 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7f635234-a825-49bc-80e1-12c86d04ddfa tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:11.258705 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-316632ab-a194-4c6a-98c3-355bdf129f0a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:11.266603 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-316632ab-a194-4c6a-98c3-355bdf129f0a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1724 microversion: 2.1 time: 0.150661 May 16 20:45:11.267258 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 432/864] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:11 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:11.356729 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-7f635234-a825-49bc-80e1-12c86d04ddfa tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:11.364198 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-7f635234-a825-49bc-80e1-12c86d04ddfa tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f" status: 200 len: 1267 microversion: 2.1 time: 0.155648 May 16 20:45:11.364813 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 433/865] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:11 2022] GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:12.284628 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-95b00f3b-41e4-409e-834d-5f15d10811d7 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:12.285267 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-95b00f3b-41e4-409e-834d-5f15d10811d7 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:12.293157 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-95b00f3b-41e4-409e-834d-5f15d10811d7 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:12.293666 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-95b00f3b-41e4-409e-834d-5f15d10811d7 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:12.294527 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-95b00f3b-41e4-409e-834d-5f15d10811d7 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:12.295017 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-95b00f3b-41e4-409e-834d-5f15d10811d7 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:12.381881 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-481f0e86-8874-47d3-823d-7956ee5370a6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:12.382611 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-481f0e86-8874-47d3-823d-7956ee5370a6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:12.391978 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-481f0e86-8874-47d3-823d-7956ee5370a6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:12.392658 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-481f0e86-8874-47d3-823d-7956ee5370a6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:12.393569 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-481f0e86-8874-47d3-823d-7956ee5370a6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:12.393980 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-481f0e86-8874-47d3-823d-7956ee5370a6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:12.441263 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-95b00f3b-41e4-409e-834d-5f15d10811d7 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:12.449705 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-95b00f3b-41e4-409e-834d-5f15d10811d7 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1724 microversion: 2.1 time: 0.169556 May 16 20:45:12.450273 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 433/866] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:12 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:12.527521 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-481f0e86-8874-47d3-823d-7956ee5370a6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:12.535146 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-481f0e86-8874-47d3-823d-7956ee5370a6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f" status: 200 len: 1267 microversion: 2.1 time: 0.157507 May 16 20:45:12.535649 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 434/867] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:12 2022] GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:13.471193 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-4b8a4a47-93bf-4827-87d1-63a16b269722 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:13.471900 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-4b8a4a47-93bf-4827-87d1-63a16b269722 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:13.478047 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4b8a4a47-93bf-4827-87d1-63a16b269722 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:13.478492 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4b8a4a47-93bf-4827-87d1-63a16b269722 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:13.479259 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4b8a4a47-93bf-4827-87d1-63a16b269722 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:13.479691 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4b8a4a47-93bf-4827-87d1-63a16b269722 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:13.551899 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-96c477e6-eec9-43c2-91ef-375ece2574cd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:13.553148 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-96c477e6-eec9-43c2-91ef-375ece2574cd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:13.559916 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-96c477e6-eec9-43c2-91ef-375ece2574cd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:13.560647 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-96c477e6-eec9-43c2-91ef-375ece2574cd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:13.561598 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-96c477e6-eec9-43c2-91ef-375ece2574cd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:13.562060 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-96c477e6-eec9-43c2-91ef-375ece2574cd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:13.656525 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-4b8a4a47-93bf-4827-87d1-63a16b269722 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:13.663218 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-4b8a4a47-93bf-4827-87d1-63a16b269722 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1724 microversion: 2.1 time: 0.198657 May 16 20:45:13.664118 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 434/868] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:13 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:45:13.720453 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-96c477e6-eec9-43c2-91ef-375ece2574cd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:13.728217 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-96c477e6-eec9-43c2-91ef-375ece2574cd tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f" status: 200 len: 1267 microversion: 2.1 time: 0.180212 May 16 20:45:13.728775 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 435/869] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:13 2022] GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:14.680985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-1b5e0f68-32e7-4f89-90e9-2e08fee9d122 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:14.681590 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-1b5e0f68-32e7-4f89-90e9-2e08fee9d122 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:14.688860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1b5e0f68-32e7-4f89-90e9-2e08fee9d122 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:14.689303 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1b5e0f68-32e7-4f89-90e9-2e08fee9d122 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:14.690061 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1b5e0f68-32e7-4f89-90e9-2e08fee9d122 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:14.690489 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1b5e0f68-32e7-4f89-90e9-2e08fee9d122 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:14.750133 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-ab6c15f1-2d90-4e18-9b5f-77cd03228294 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:14.750760 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-ab6c15f1-2d90-4e18-9b5f-77cd03228294 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:14.760415 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ab6c15f1-2d90-4e18-9b5f-77cd03228294 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:14.760859 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ab6c15f1-2d90-4e18-9b5f-77cd03228294 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:14.761668 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ab6c15f1-2d90-4e18-9b5f-77cd03228294 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:14.762067 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ab6c15f1-2d90-4e18-9b5f-77cd03228294 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:14.866133 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-1b5e0f68-32e7-4f89-90e9-2e08fee9d122 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:14.874462 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-1b5e0f68-32e7-4f89-90e9-2e08fee9d122 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1724 microversion: 2.1 time: 0.197335 May 16 20:45:14.874993 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 435/870] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:14 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:14.911201 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ab6c15f1-2d90-4e18-9b5f-77cd03228294 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:14.918672 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-ab6c15f1-2d90-4e18-9b5f-77cd03228294 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f" status: 200 len: 1267 microversion: 2.1 time: 0.172438 May 16 20:45:14.919226 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 436/871] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:14 2022] GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:45:15.209552 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-ddb5713c-5950-4009-bba8-22253501ee42 req-32eb37dd-7ffc-419c-a8c7-4d1b34abb63c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "117d359a-7af9-46f0-bffb-d12ad46a929f", "name": "network-vif-plugged", "status": "completed", "tag": "996a4b17-c006-48b9-b68b-6329ea3a6c7a"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:45:15.219687 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-ddb5713c-5950-4009-bba8-22253501ee42 req-32eb37dd-7ffc-419c-a8c7-4d1b34abb63c service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:15.220139 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-ddb5713c-5950-4009-bba8-22253501ee42 req-32eb37dd-7ffc-419c-a8c7-4d1b34abb63c service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:15.232160 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-ddb5713c-5950-4009-bba8-22253501ee42 req-32eb37dd-7ffc-419c-a8c7-4d1b34abb63c service nova] Creating event network-vif-plugged:996a4b17-c006-48b9-b68b-6329ea3a6c7a for instance 117d359a-7af9-46f0-bffb-d12ad46a929f on hv-cinder-77703 May 16 20:45:15.237265 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-ddb5713c-5950-4009-bba8-22253501ee42 req-32eb37dd-7ffc-419c-a8c7-4d1b34abb63c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031536 May 16 20:45:15.238079 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 436/872] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:45:15.895651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-a0b9cf8a-cf74-452f-91b6-038fa9487581 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:15.896568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-a0b9cf8a-cf74-452f-91b6-038fa9487581 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:15.907117 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a0b9cf8a-cf74-452f-91b6-038fa9487581 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:15.907863 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a0b9cf8a-cf74-452f-91b6-038fa9487581 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:15.908936 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a0b9cf8a-cf74-452f-91b6-038fa9487581 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:15.909366 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a0b9cf8a-cf74-452f-91b6-038fa9487581 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:15.935818 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-4e1b682f-d8f9-4c22-bd7e-c5390bf0b6e6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:15.936636 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-4e1b682f-d8f9-4c22-bd7e-c5390bf0b6e6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:15.943834 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4e1b682f-d8f9-4c22-bd7e-c5390bf0b6e6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:15.944279 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4e1b682f-d8f9-4c22-bd7e-c5390bf0b6e6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:15.945085 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4e1b682f-d8f9-4c22-bd7e-c5390bf0b6e6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:15.945511 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4e1b682f-d8f9-4c22-bd7e-c5390bf0b6e6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:16.089185 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a0b9cf8a-cf74-452f-91b6-038fa9487581 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:16.097863 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-a0b9cf8a-cf74-452f-91b6-038fa9487581 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1724 microversion: 2.1 time: 0.208651 May 16 20:45:16.098443 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 437/873] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:15 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:16.123987 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-4e1b682f-d8f9-4c22-bd7e-c5390bf0b6e6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:16.132031 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-4e1b682f-d8f9-4c22-bd7e-c5390bf0b6e6 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f" status: 200 len: 1267 microversion: 2.1 time: 0.200539 May 16 20:45:16.132639 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 437/874] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:15 2022] GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:17.120783 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-eff17bf9-2b6f-4c1e-8412-d8663e07523d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:17.121568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-eff17bf9-2b6f-4c1e-8412-d8663e07523d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:17.129149 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-eff17bf9-2b6f-4c1e-8412-d8663e07523d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:17.129881 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-eff17bf9-2b6f-4c1e-8412-d8663e07523d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:17.130682 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-eff17bf9-2b6f-4c1e-8412-d8663e07523d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:17.131121 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-eff17bf9-2b6f-4c1e-8412-d8663e07523d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:17.150897 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-3bda15fb-759c-405f-8a75-545cdc506f9f tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:17.151546 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-3bda15fb-759c-405f-8a75-545cdc506f9f tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:17.160381 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3bda15fb-759c-405f-8a75-545cdc506f9f tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:17.160880 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3bda15fb-759c-405f-8a75-545cdc506f9f tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:17.161978 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3bda15fb-759c-405f-8a75-545cdc506f9f tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:17.162408 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3bda15fb-759c-405f-8a75-545cdc506f9f tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:17.328984 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-eff17bf9-2b6f-4c1e-8412-d8663e07523d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:17.337254 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-eff17bf9-2b6f-4c1e-8412-d8663e07523d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1724 microversion: 2.1 time: 0.221870 May 16 20:45:17.337836 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 438/875] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:17 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:45:17.341676 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3bda15fb-759c-405f-8a75-545cdc506f9f tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:17.349364 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-3bda15fb-759c-405f-8a75-545cdc506f9f tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f" status: 200 len: 1454 microversion: 2.1 time: 0.203832 May 16 20:45:17.349930 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 438/876] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:17 2022] GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f => generated 1454 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:17.365770 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-022c2997-d564-4fe4-a113-3583b2106edc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:17.366384 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-022c2997-d564-4fe4-a113-3583b2106edc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:17.372751 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-022c2997-d564-4fe4-a113-3583b2106edc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:17.373144 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-022c2997-d564-4fe4-a113-3583b2106edc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:17.373896 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-022c2997-d564-4fe4-a113-3583b2106edc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:17.374321 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-022c2997-d564-4fe4-a113-3583b2106edc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:17.525070 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-022c2997-d564-4fe4-a113-3583b2106edc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:17.536459 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-022c2997-d564-4fe4-a113-3583b2106edc tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f" status: 200 len: 1454 microversion: 2.1 time: 0.174245 May 16 20:45:17.537223 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 439/877] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:17 2022] GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f => generated 1454 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:18.354748 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-2618883b-edef-4a77-96b7-180dfcad359d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:18.355335 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-2618883b-edef-4a77-96b7-180dfcad359d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:18.362214 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2618883b-edef-4a77-96b7-180dfcad359d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:18.362675 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2618883b-edef-4a77-96b7-180dfcad359d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:18.363461 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2618883b-edef-4a77-96b7-180dfcad359d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:18.363903 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2618883b-edef-4a77-96b7-180dfcad359d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:18.562627 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2618883b-edef-4a77-96b7-180dfcad359d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:18.571920 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-2618883b-edef-4a77-96b7-180dfcad359d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1724 microversion: 2.1 time: 0.221039 May 16 20:45:18.572501 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 439/878] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:18 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:19.535586 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-a7f52c3c-4ba0-4b66-bfb0-5a7e1e60d18a req-c053fe26-cafb-4e89-bffa-4081ccf10151 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "117d359a-7af9-46f0-bffb-d12ad46a929f", "tag": "996a4b17-c006-48b9-b68b-6329ea3a6c7a"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:45:19.543964 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-a7f52c3c-4ba0-4b66-bfb0-5a7e1e60d18a req-c053fe26-cafb-4e89-bffa-4081ccf10151 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:19.544406 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-a7f52c3c-4ba0-4b66-bfb0-5a7e1e60d18a req-c053fe26-cafb-4e89-bffa-4081ccf10151 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:19.555560 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-a7f52c3c-4ba0-4b66-bfb0-5a7e1e60d18a req-c053fe26-cafb-4e89-bffa-4081ccf10151 service nova] Creating event network-changed:996a4b17-c006-48b9-b68b-6329ea3a6c7a for instance 117d359a-7af9-46f0-bffb-d12ad46a929f on hv-cinder-77703 May 16 20:45:19.560788 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-a7f52c3c-4ba0-4b66-bfb0-5a7e1e60d18a req-c053fe26-cafb-4e89-bffa-4081ccf10151 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028972 May 16 20:45:19.561406 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 440/879] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:45:19.589114 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-9fc4a57c-3905-47a7-8f7b-087893550d4d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:19.589867 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-9fc4a57c-3905-47a7-8f7b-087893550d4d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:19.596584 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9fc4a57c-3905-47a7-8f7b-087893550d4d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:19.597016 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9fc4a57c-3905-47a7-8f7b-087893550d4d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:19.597795 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9fc4a57c-3905-47a7-8f7b-087893550d4d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:19.598230 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9fc4a57c-3905-47a7-8f7b-087893550d4d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:19.731272 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-9fc4a57c-3905-47a7-8f7b-087893550d4d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:19.739992 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-9fc4a57c-3905-47a7-8f7b-087893550d4d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1724 microversion: 2.1 time: 0.154701 May 16 20:45:19.740576 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 440/880] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:19 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:20.757640 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-1023e2f0-7e1b-4b03-ab0b-5d212d3bafe8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:20.758336 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-1023e2f0-7e1b-4b03-ab0b-5d212d3bafe8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:20.764796 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1023e2f0-7e1b-4b03-ab0b-5d212d3bafe8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:20.765249 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1023e2f0-7e1b-4b03-ab0b-5d212d3bafe8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:20.766023 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1023e2f0-7e1b-4b03-ab0b-5d212d3bafe8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:20.766489 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1023e2f0-7e1b-4b03-ab0b-5d212d3bafe8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:20.907603 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-1023e2f0-7e1b-4b03-ab0b-5d212d3bafe8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:20.918408 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-1023e2f0-7e1b-4b03-ab0b-5d212d3bafe8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1724 microversion: 2.1 time: 0.165183 May 16 20:45:20.919255 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 441/881] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:20 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:21.945221 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-aa427059-4d44-4e57-94ea-fdedb9e062e1 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:21.946283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-aa427059-4d44-4e57-94ea-fdedb9e062e1 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:21.956794 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-aa427059-4d44-4e57-94ea-fdedb9e062e1 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:21.957250 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-aa427059-4d44-4e57-94ea-fdedb9e062e1 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:21.958021 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-aa427059-4d44-4e57-94ea-fdedb9e062e1 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:21.958451 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-aa427059-4d44-4e57-94ea-fdedb9e062e1 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:22.098533 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-aa427059-4d44-4e57-94ea-fdedb9e062e1 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:22.106882 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-aa427059-4d44-4e57-94ea-fdedb9e062e1 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1724 microversion: 2.1 time: 0.168692 May 16 20:45:22.107463 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 441/882] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:21 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:23.127332 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-ca161ab8-b967-4b7a-a7ed-2fc1ea7e416a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:23.128108 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-ca161ab8-b967-4b7a-a7ed-2fc1ea7e416a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:23.134857 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ca161ab8-b967-4b7a-a7ed-2fc1ea7e416a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:23.135295 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ca161ab8-b967-4b7a-a7ed-2fc1ea7e416a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:23.136055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ca161ab8-b967-4b7a-a7ed-2fc1ea7e416a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:23.136483 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ca161ab8-b967-4b7a-a7ed-2fc1ea7e416a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:23.285716 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ca161ab8-b967-4b7a-a7ed-2fc1ea7e416a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:23.293716 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-ca161ab8-b967-4b7a-a7ed-2fc1ea7e416a tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1724 microversion: 2.1 time: 0.172879 May 16 20:45:23.294291 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 442/883] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:23 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:24.311096 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-9fa77c69-d7c9-4ee3-8421-892a79516999 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:24.312377 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-9fa77c69-d7c9-4ee3-8421-892a79516999 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:24.320008 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9fa77c69-d7c9-4ee3-8421-892a79516999 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:24.320474 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9fa77c69-d7c9-4ee3-8421-892a79516999 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:24.321275 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9fa77c69-d7c9-4ee3-8421-892a79516999 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:24.321712 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9fa77c69-d7c9-4ee3-8421-892a79516999 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:24.449122 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-9fa77c69-d7c9-4ee3-8421-892a79516999 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:24.457500 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-9fa77c69-d7c9-4ee3-8421-892a79516999 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1724 microversion: 2.1 time: 0.150309 May 16 20:45:24.458071 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 442/884] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:24 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:45:25.478416 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-73a5f8c4-1902-4584-9278-2147540e677d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:25.479338 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-73a5f8c4-1902-4584-9278-2147540e677d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:25.490204 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-73a5f8c4-1902-4584-9278-2147540e677d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:25.490959 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-73a5f8c4-1902-4584-9278-2147540e677d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:25.492248 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-73a5f8c4-1902-4584-9278-2147540e677d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:25.493027 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-73a5f8c4-1902-4584-9278-2147540e677d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:25.632693 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-73a5f8c4-1902-4584-9278-2147540e677d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:25.641057 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-73a5f8c4-1902-4584-9278-2147540e677d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1724 microversion: 2.1 time: 0.169551 May 16 20:45:25.641624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 443/885] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:25 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:26.658655 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-011c7c92-a58d-4327-866e-edc5e5c88048 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:26.659350 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-011c7c92-a58d-4327-866e-edc5e5c88048 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:26.666083 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-011c7c92-a58d-4327-866e-edc5e5c88048 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:26.666538 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-011c7c92-a58d-4327-866e-edc5e5c88048 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:26.667318 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-011c7c92-a58d-4327-866e-edc5e5c88048 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:26.667756 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-011c7c92-a58d-4327-866e-edc5e5c88048 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:26.801134 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-011c7c92-a58d-4327-866e-edc5e5c88048 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:26.809035 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-011c7c92-a58d-4327-866e-edc5e5c88048 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1724 microversion: 2.1 time: 0.154617 May 16 20:45:26.809614 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 443/886] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:26 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:27.826651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-d0721d63-b613-4290-892a-cb1333ec6267 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:27.827230 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-d0721d63-b613-4290-892a-cb1333ec6267 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:27.834029 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d0721d63-b613-4290-892a-cb1333ec6267 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:27.834479 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d0721d63-b613-4290-892a-cb1333ec6267 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:27.835268 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d0721d63-b613-4290-892a-cb1333ec6267 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:27.835693 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d0721d63-b613-4290-892a-cb1333ec6267 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:27.964836 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d0721d63-b613-4290-892a-cb1333ec6267 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:27.973265 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-d0721d63-b613-4290-892a-cb1333ec6267 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1724 microversion: 2.1 time: 0.150615 May 16 20:45:27.973844 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 444/887] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:27 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:28.994750 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-41f72449-75b7-4164-85f9-c1ae219dd7f8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:28.995565 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-41f72449-75b7-4164-85f9-c1ae219dd7f8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:29.005033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-41f72449-75b7-4164-85f9-c1ae219dd7f8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:29.005666 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-41f72449-75b7-4164-85f9-c1ae219dd7f8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:29.006750 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-41f72449-75b7-4164-85f9-c1ae219dd7f8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:29.007366 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-41f72449-75b7-4164-85f9-c1ae219dd7f8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:29.154649 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-41f72449-75b7-4164-85f9-c1ae219dd7f8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:29.163253 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-41f72449-75b7-4164-85f9-c1ae219dd7f8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1724 microversion: 2.1 time: 0.175023 May 16 20:45:29.163799 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 444/888] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:28 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:29.724604 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-a35adb9e-2778-4e79-b886-d9a424ed6839 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:29.725085 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-a35adb9e-2778-4e79-b886-d9a424ed6839 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 873a9d69-1266-4bcc-9b5a-336b903ff358] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:29.731890 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a35adb9e-2778-4e79-b886-d9a424ed6839 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:29.732341 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a35adb9e-2778-4e79-b886-d9a424ed6839 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:29.733156 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a35adb9e-2778-4e79-b886-d9a424ed6839 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:29.733591 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a35adb9e-2778-4e79-b886-d9a424ed6839 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:29.814294 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.objects.instance [None req-a35adb9e-2778-4e79-b886-d9a424ed6839 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lazy-loading 'services' on Instance uuid 873a9d69-1266-4bcc-9b5a-336b903ff358 {{(pid=123563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:45:29.897178 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-a35adb9e-2778-4e79-b886-d9a424ed6839 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "DELETE /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358/os-volume_attachments/9c0ebc20-8e9a-410b-a7b5-5e408801838e" status: 202 len: 0 microversion: 2.1 time: 0.176123 May 16 20:45:29.898037 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 445/889] 10.222.0.49 () {58 vars in 1415 bytes} [Mon May 16 20:45:29 2022] DELETE /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358/os-volume_attachments/9c0ebc20-8e9a-410b-a7b5-5e408801838e => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:45:30.182284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-ecc9580d-1848-4dc3-812d-6d80fda1c537 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:30.182963 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-ecc9580d-1848-4dc3-812d-6d80fda1c537 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:30.191465 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ecc9580d-1848-4dc3-812d-6d80fda1c537 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:30.191916 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ecc9580d-1848-4dc3-812d-6d80fda1c537 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:30.192727 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ecc9580d-1848-4dc3-812d-6d80fda1c537 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:30.193165 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ecc9580d-1848-4dc3-812d-6d80fda1c537 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:30.325315 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-ecc9580d-1848-4dc3-812d-6d80fda1c537 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:30.334119 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-ecc9580d-1848-4dc3-812d-6d80fda1c537 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1724 microversion: 2.1 time: 0.156799 May 16 20:45:30.334696 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 445/890] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:30 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:31.026145 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-670fd5ad-ad83-49c8-9430-73df0e8126a1 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:31.026696 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-670fd5ad-ad83-49c8-9430-73df0e8126a1 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 873a9d69-1266-4bcc-9b5a-336b903ff358] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:31.033513 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-670fd5ad-ad83-49c8-9430-73df0e8126a1 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:31.033983 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-670fd5ad-ad83-49c8-9430-73df0e8126a1 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:31.034746 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-670fd5ad-ad83-49c8-9430-73df0e8126a1 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:31.035171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-670fd5ad-ad83-49c8-9430-73df0e8126a1 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:31.060557 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-670fd5ad-ad83-49c8-9430-73df0e8126a1 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 873a9d69-1266-4bcc-9b5a-336b903ff358] Going to try to terminate instance {{(pid=123563) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:45:31.140012 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-670fd5ad-ad83-49c8-9430-73df0e8126a1 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "DELETE /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358" status: 204 len: 0 microversion: 2.1 time: 0.118238 May 16 20:45:31.140642 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 446/891] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:45:31 2022] DELETE /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 20:45:31.150016 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-de42765b-3eaf-415e-8c16-486d507a512a tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:31.150580 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-de42765b-3eaf-415e-8c16-486d507a512a tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 873a9d69-1266-4bcc-9b5a-336b903ff358] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:31.157394 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-de42765b-3eaf-415e-8c16-486d507a512a tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:31.157836 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-de42765b-3eaf-415e-8c16-486d507a512a tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:31.159130 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-de42765b-3eaf-415e-8c16-486d507a512a tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:31.159732 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-de42765b-3eaf-415e-8c16-486d507a512a tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:31.292962 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-de42765b-3eaf-415e-8c16-486d507a512a tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:31.300961 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-de42765b-3eaf-415e-8c16-486d507a512a tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358" status: 200 len: 1514 microversion: 2.1 time: 0.155208 May 16 20:45:31.301534 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 446/892] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:31 2022] GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:31.351881 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-f268b479-6df2-43b3-af3d-a3263870061d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:31.352621 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-f268b479-6df2-43b3-af3d-a3263870061d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:31.359261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f268b479-6df2-43b3-af3d-a3263870061d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:31.359717 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f268b479-6df2-43b3-af3d-a3263870061d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:31.360495 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f268b479-6df2-43b3-af3d-a3263870061d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:31.360961 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f268b479-6df2-43b3-af3d-a3263870061d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:31.499870 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f268b479-6df2-43b3-af3d-a3263870061d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:31.508606 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-f268b479-6df2-43b3-af3d-a3263870061d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1724 microversion: 2.1 time: 0.160916 May 16 20:45:31.509204 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 447/893] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:31 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:45:32.323081 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-707e03a9-e9e4-47c2-96a5-d0301a051dfd tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:32.324031 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-707e03a9-e9e4-47c2-96a5-d0301a051dfd tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 873a9d69-1266-4bcc-9b5a-336b903ff358] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:32.334793 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-707e03a9-e9e4-47c2-96a5-d0301a051dfd tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:32.335574 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-707e03a9-e9e4-47c2-96a5-d0301a051dfd tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:32.336844 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-707e03a9-e9e4-47c2-96a5-d0301a051dfd tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:32.337555 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-707e03a9-e9e4-47c2-96a5-d0301a051dfd tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:32.476257 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-707e03a9-e9e4-47c2-96a5-d0301a051dfd tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:32.487585 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-707e03a9-e9e4-47c2-96a5-d0301a051dfd tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358" status: 200 len: 1514 microversion: 2.1 time: 0.170992 May 16 20:45:32.488258 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 447/894] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:32 2022] GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:32.525717 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-c715fd10-d273-4db8-a02f-e425feaf1b1e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:32.526288 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-c715fd10-d273-4db8-a02f-e425feaf1b1e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:32.533225 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c715fd10-d273-4db8-a02f-e425feaf1b1e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:32.533680 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c715fd10-d273-4db8-a02f-e425feaf1b1e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:32.534452 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c715fd10-d273-4db8-a02f-e425feaf1b1e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:32.534883 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c715fd10-d273-4db8-a02f-e425feaf1b1e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:32.672158 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-c715fd10-d273-4db8-a02f-e425feaf1b1e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:32.680603 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-c715fd10-d273-4db8-a02f-e425feaf1b1e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1724 microversion: 2.1 time: 0.158684 May 16 20:45:32.681175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 448/895] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:32 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:33.507347 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-9d6fbd35-e7f1-4fce-9757-4d0cb8f44d7c tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:33.509170 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-9d6fbd35-e7f1-4fce-9757-4d0cb8f44d7c tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 873a9d69-1266-4bcc-9b5a-336b903ff358] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:33.520479 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9d6fbd35-e7f1-4fce-9757-4d0cb8f44d7c tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:33.521080 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9d6fbd35-e7f1-4fce-9757-4d0cb8f44d7c tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:33.521856 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9d6fbd35-e7f1-4fce-9757-4d0cb8f44d7c tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:33.522282 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-9d6fbd35-e7f1-4fce-9757-4d0cb8f44d7c tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:33.560866 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-e69f1090-b2e6-46cf-819f-97a8ebe7dadc req-b1f89ee4-ab16-4f87-9b00-916a1c41a35b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873a9d69-1266-4bcc-9b5a-336b903ff358", "name": "network-vif-deleted", "tag": "201b5a31-be5b-4eff-8be6-2ce2363277d7"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:45:33.571192 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-e69f1090-b2e6-46cf-819f-97a8ebe7dadc req-b1f89ee4-ab16-4f87-9b00-916a1c41a35b service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:33.571718 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-e69f1090-b2e6-46cf-819f-97a8ebe7dadc req-b1f89ee4-ab16-4f87-9b00-916a1c41a35b service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:33.584145 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-e69f1090-b2e6-46cf-819f-97a8ebe7dadc req-b1f89ee4-ab16-4f87-9b00-916a1c41a35b service nova] Creating event network-vif-deleted:201b5a31-be5b-4eff-8be6-2ce2363277d7 for instance 873a9d69-1266-4bcc-9b5a-336b903ff358 on hv-cinder-77703 May 16 20:45:33.589418 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-e69f1090-b2e6-46cf-819f-97a8ebe7dadc req-b1f89ee4-ab16-4f87-9b00-916a1c41a35b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031929 May 16 20:45:33.590401 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 449/896] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:45:33.594345 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-9d6fbd35-e7f1-4fce-9757-4d0cb8f44d7c tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b413f53d6e404fa3d613d21d07afc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579a6c29476643ed997c798ed64bc409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:33.607424 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-9d6fbd35-e7f1-4fce-9757-4d0cb8f44d7c tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358" status: 200 len: 1472 microversion: 2.1 time: 0.105552 May 16 20:45:33.608030 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 448/897] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:33 2022] GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358 => generated 1472 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:33.699296 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-a4760963-76c6-46e8-ab96-571d7c58adb2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:33.699993 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-a4760963-76c6-46e8-ab96-571d7c58adb2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:33.706382 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a4760963-76c6-46e8-ab96-571d7c58adb2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:33.706780 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a4760963-76c6-46e8-ab96-571d7c58adb2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:33.707771 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a4760963-76c6-46e8-ab96-571d7c58adb2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:33.708207 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a4760963-76c6-46e8-ab96-571d7c58adb2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:33.836831 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a4760963-76c6-46e8-ab96-571d7c58adb2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:33.845696 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-a4760963-76c6-46e8-ab96-571d7c58adb2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1701 microversion: 2.1 time: 0.150868 May 16 20:45:33.846275 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 450/898] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:33 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1701 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:33.861872 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-4d5cc94c-6631-4391-a062-7d752a41adcf tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:45:33.868327 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4d5cc94c-6631-4391-a062-7d752a41adcf tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:33.868879 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4d5cc94c-6631-4391-a062-7d752a41adcf tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:33.927433 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-4d5cc94c-6631-4391-a062-7d752a41adcf tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Going to try to start instance {{(pid=123564) start /opt/stack/nova/nova/compute/api.py:2730}} May 16 20:45:33.970171 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-4d5cc94c-6631-4391-a062-7d752a41adcf tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "POST /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040/action" status: 202 len: 0 microversion: 2.1 time: 0.111907 May 16 20:45:33.971035 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 449/899] 10.222.0.49 () {60 vars in 1277 bytes} [Mon May 16 20:45:33 2022] POST /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 20:45:33.979050 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-643a8f81-9a5a-47f6-9af0-d5b4124d47c0 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:33.979675 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-643a8f81-9a5a-47f6-9af0-d5b4124d47c0 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:33.989213 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-643a8f81-9a5a-47f6-9af0-d5b4124d47c0 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:33.989656 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-643a8f81-9a5a-47f6-9af0-d5b4124d47c0 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:33.990419 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-643a8f81-9a5a-47f6-9af0-d5b4124d47c0 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:33.990887 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-643a8f81-9a5a-47f6-9af0-d5b4124d47c0 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:34.128704 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-643a8f81-9a5a-47f6-9af0-d5b4124d47c0 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:34.137206 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-643a8f81-9a5a-47f6-9af0-d5b4124d47c0 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1710 microversion: 2.1 time: 0.162073 May 16 20:45:34.137754 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 451/900] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:33 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:34.626186 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6a41e615-033d-43ed-ae09-791c1f2037f5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:34.626751 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-6a41e615-033d-43ed-ae09-791c1f2037f5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] [instance: 873a9d69-1266-4bcc-9b5a-336b903ff358] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:34.633773 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6a41e615-033d-43ed-ae09-791c1f2037f5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:34.634223 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6a41e615-033d-43ed-ae09-791c1f2037f5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:34.635009 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6a41e615-033d-43ed-ae09-791c1f2037f5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:34.635446 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6a41e615-033d-43ed-ae09-791c1f2037f5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:34.649677 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-6a41e615-033d-43ed-ae09-791c1f2037f5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] HTTP exception thrown: Instance 873a9d69-1266-4bcc-9b5a-336b903ff358 could not be found. May 16 20:45:34.651336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6a41e615-033d-43ed-ae09-791c1f2037f5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Request method failure captured: May 16 20:45:34.651336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358 HTTP/1.1 May 16 20:45:34.651336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:45:34.651336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:45:34.651336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:45:34.651336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:45:34.651336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:45:34.651336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:45:34.651336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:45:34.651336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:45:34.651336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigreGKaxX25B34lq585Vl3cwTtsThedysnHGoDkHammzuveAVlfbrWWajzrpvBJSF_VRLaRT62psIzQBKzTBhLSEZX8sFEo34jrLBsPxK9IXe1QwXaKvI8dkvxkU5fb2UgB2Ma9sJFgT3nmXpzLqZuEcI66pg3krp1ljxO-LEzS9pqwA May 16 20:45:34.651336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:45:34.651336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:45:34.651336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:45:34.651336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:45:34.651336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:45:34.651336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:45:34.651336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 579a6c29476643ed997c798ed64bc409 May 16 20:45:34.651336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-VolumesSnapshotTestJSON-599123165 May 16 20:45:34.651336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:45:34.651336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:45:34.653063 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_579a6c29476643ed997c798ed64bc409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/579a6c29476643ed997c798ed64bc409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/579a6c29476643ed997c798ed64bc409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/579a6c29476643ed997c798ed64bc409"}]}] May 16 20:45:34.653063 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-VolumesSnapshotTestJSON-599123165 May 16 20:45:34.653063 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 579a6c29476643ed997c798ed64bc409 May 16 20:45:34.653063 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-599123165 May 16 20:45:34.653063 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-VolumesSnapshotTestJSON-599123165-project May 16 20:45:34.653063 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:45:34.653063 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:45:34.653063 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: 28b413f53d6e404fa3d613d21d07afc7 May 16 20:45:34.653063 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-VolumesSnapshotTestJSON-599123165-project May 16 20:45:34.653063 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:45:34.653063 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance 873a9d69-1266-4bcc-9b5a-336b903ff358 could not be found. May 16 20:45:34.653063 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': '873a9d69-1266-4bcc-9b5a-336b903ff358'} May 16 20:45:34.653894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:45:34.653894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:45:34.653894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:45:34.653894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:45:34.653894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:45:34.653894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:45:34.653894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:45:34.653894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:45:34.653894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:45:34.653894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:45:34.653894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 873a9d69-1266-4bcc-9b5a-336b903ff358 could not be found. May 16 20:45:34.653894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:45:34.653894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:45:34.653894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:45:34.653894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:45:34.653894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:45:34.653894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:45:34.653894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:45:34.653894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:45:34.653894 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:45:34.655261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:45:34.655261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:45:34.655261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:45:34.655261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:45:34.655261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:45:34.655261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:45:34.655261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:45:34.655261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 873a9d69-1266-4bcc-9b5a-336b903ff358 could not be found. May 16 20:45:34.655261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:45:34.655261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:45:34.655261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:45:34.655261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:45:34.655261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:45:34.655261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:45:34.655261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:45:34.655261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:45:34.655261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 873a9d69-1266-4bcc-9b5a-336b903ff358 could not be found. May 16 20:45:34.655261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:45:34.657583 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6a41e615-033d-43ed-ae09-791c1f2037f5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] Returning 404 to user: Instance 873a9d69-1266-4bcc-9b5a-336b903ff358 could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:45:34.657583 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-6a41e615-033d-43ed-ae09-791c1f2037f5 tempest-VolumesSnapshotTestJSON-599123165 tempest-VolumesSnapshotTestJSON-599123165-project] 10.222.0.49 "GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358" status: 404 len: 111 microversion: 2.1 time: 0.031524 May 16 20:45:34.657583 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 450/901] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:34 2022] GET /compute/v2.1/servers/873a9d69-1266-4bcc-9b5a-336b903ff358 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:45:35.160118 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-de4262fd-edf6-4ade-be3c-010e825ad62e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:35.160751 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-de4262fd-edf6-4ade-be3c-010e825ad62e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:35.167515 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-de4262fd-edf6-4ade-be3c-010e825ad62e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:35.168002 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-de4262fd-edf6-4ade-be3c-010e825ad62e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:35.168960 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-de4262fd-edf6-4ade-be3c-010e825ad62e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:35.169450 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-de4262fd-edf6-4ade-be3c-010e825ad62e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:35.306262 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-de4262fd-edf6-4ade-be3c-010e825ad62e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:35.314615 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-de4262fd-edf6-4ade-be3c-010e825ad62e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1710 microversion: 2.1 time: 0.160836 May 16 20:45:35.315158 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 452/902] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:35 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:45:36.335576 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-2195321a-ce79-4df8-a9a1-5d8c62a9af5b tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:45:36.336398 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-2195321a-ce79-4df8-a9a1-5d8c62a9af5b tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:45:36.347179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2195321a-ce79-4df8-a9a1-5d8c62a9af5b tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:36.347924 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2195321a-ce79-4df8-a9a1-5d8c62a9af5b tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:36.349301 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2195321a-ce79-4df8-a9a1-5d8c62a9af5b tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:45:36.350052 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-2195321a-ce79-4df8-a9a1-5d8c62a9af5b tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:45:36.485204 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-2195321a-ce79-4df8-a9a1-5d8c62a9af5b tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:45:36.494442 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-2195321a-ce79-4df8-a9a1-5d8c62a9af5b tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1714 microversion: 2.1 time: 0.165624 May 16 20:45:36.495018 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 451/903] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:45:36 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1714 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:09.828061 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-e2431ee6-ea42-4fa4-b3dd-b718867c5dc4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:09.828855 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-e2431ee6-ea42-4fa4-b3dd-b718867c5dc4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:09.837471 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e2431ee6-ea42-4fa4-b3dd-b718867c5dc4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:09.838088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e2431ee6-ea42-4fa4-b3dd-b718867c5dc4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:09.839065 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e2431ee6-ea42-4fa4-b3dd-b718867c5dc4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:09.839642 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e2431ee6-ea42-4fa4-b3dd-b718867c5dc4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:09.927694 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.objects.instance [None req-e2431ee6-ea42-4fa4-b3dd-b718867c5dc4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lazy-loading 'services' on Instance uuid a733942d-a211-4c45-9fcf-8eab9293e040 {{(pid=123563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:46:10.003157 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-e2431ee6-ea42-4fa4-b3dd-b718867c5dc4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040/os-volume_attachments/7c16d356-3f5e-4f7f-b3c5-e3b73662b9d3" status: 202 len: 0 microversion: 2.1 time: 0.180340 May 16 20:46:10.003795 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 453/904] 10.222.0.49 () {58 vars in 1415 bytes} [Mon May 16 20:46:09 2022] DELETE /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040/os-volume_attachments/7c16d356-3f5e-4f7f-b3c5-e3b73662b9d3 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:46:11.137788 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6278bd0b-7f1e-44bd-9fa1-f2ffd2220a5c tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:46:11.144119 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6278bd0b-7f1e-44bd-9fa1-f2ffd2220a5c tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:11.144595 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6278bd0b-7f1e-44bd-9fa1-f2ffd2220a5c tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:11.167428 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-6278bd0b-7f1e-44bd-9fa1-f2ffd2220a5c tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Going to try to stop instance {{(pid=123564) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 16 20:46:11.214472 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-6278bd0b-7f1e-44bd-9fa1-f2ffd2220a5c tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "POST /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040/action" status: 202 len: 0 microversion: 2.1 time: 0.080401 May 16 20:46:11.215137 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 452/905] 10.222.0.49 () {60 vars in 1277 bytes} [Mon May 16 20:46:11 2022] POST /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:46:11.224447 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-d56c9e82-e18a-4de6-ba93-f8d9f94fc3c9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:11.225212 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-d56c9e82-e18a-4de6-ba93-f8d9f94fc3c9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:11.231867 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d56c9e82-e18a-4de6-ba93-f8d9f94fc3c9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:11.232461 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d56c9e82-e18a-4de6-ba93-f8d9f94fc3c9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:11.233273 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d56c9e82-e18a-4de6-ba93-f8d9f94fc3c9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:11.233878 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d56c9e82-e18a-4de6-ba93-f8d9f94fc3c9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:11.376119 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-d56c9e82-e18a-4de6-ba93-f8d9f94fc3c9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:11.384298 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-d56c9e82-e18a-4de6-ba93-f8d9f94fc3c9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1678 microversion: 2.1 time: 0.164669 May 16 20:46:11.384915 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 454/906] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:11 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:46:12.407650 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-eab12cd6-5e14-4903-9840-ffca0f11c9b8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:12.408844 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-eab12cd6-5e14-4903-9840-ffca0f11c9b8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:12.419380 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-eab12cd6-5e14-4903-9840-ffca0f11c9b8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:12.420120 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-eab12cd6-5e14-4903-9840-ffca0f11c9b8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:12.421428 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-eab12cd6-5e14-4903-9840-ffca0f11c9b8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:12.422140 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-eab12cd6-5e14-4903-9840-ffca0f11c9b8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:12.569362 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-eab12cd6-5e14-4903-9840-ffca0f11c9b8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:12.577564 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-eab12cd6-5e14-4903-9840-ffca0f11c9b8 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1678 microversion: 2.1 time: 0.178002 May 16 20:46:12.578140 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 453/907] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:12 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:13.599290 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-1a315112-2613-446c-83f0-f59808145bde tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:13.600113 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-1a315112-2613-446c-83f0-f59808145bde tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:13.607101 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1a315112-2613-446c-83f0-f59808145bde tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:13.607523 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1a315112-2613-446c-83f0-f59808145bde tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:13.608304 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1a315112-2613-446c-83f0-f59808145bde tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:13.608769 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1a315112-2613-446c-83f0-f59808145bde tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:13.741689 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-1a315112-2613-446c-83f0-f59808145bde tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:13.749645 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-1a315112-2613-446c-83f0-f59808145bde tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1678 microversion: 2.1 time: 0.157014 May 16 20:46:13.750243 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 455/908] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:13 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:14.770826 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-362c833f-883c-40f8-95df-106cc6887357 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:14.771831 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-362c833f-883c-40f8-95df-106cc6887357 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:14.779827 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-362c833f-883c-40f8-95df-106cc6887357 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:14.780360 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-362c833f-883c-40f8-95df-106cc6887357 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:14.781318 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-362c833f-883c-40f8-95df-106cc6887357 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:14.781834 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-362c833f-883c-40f8-95df-106cc6887357 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:14.925675 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-362c833f-883c-40f8-95df-106cc6887357 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:14.937159 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-362c833f-883c-40f8-95df-106cc6887357 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1678 microversion: 2.1 time: 0.172693 May 16 20:46:14.937910 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 454/909] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:14 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:15.959368 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-3e305fab-d90e-4925-ad0f-af8ffa311656 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:15.960232 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-3e305fab-d90e-4925-ad0f-af8ffa311656 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:15.971167 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3e305fab-d90e-4925-ad0f-af8ffa311656 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:15.971918 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3e305fab-d90e-4925-ad0f-af8ffa311656 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:15.973269 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3e305fab-d90e-4925-ad0f-af8ffa311656 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:15.973993 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3e305fab-d90e-4925-ad0f-af8ffa311656 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:16.279248 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-3e305fab-d90e-4925-ad0f-af8ffa311656 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:16.289649 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-3e305fab-d90e-4925-ad0f-af8ffa311656 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1678 microversion: 2.1 time: 0.337010 May 16 20:46:16.290210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 456/910] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:15 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1678 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:17.307978 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e821c7bf-2ca2-4c8e-9174-863abb5c078e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:17.308718 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-e821c7bf-2ca2-4c8e-9174-863abb5c078e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:17.315389 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e821c7bf-2ca2-4c8e-9174-863abb5c078e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:17.316179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e821c7bf-2ca2-4c8e-9174-863abb5c078e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:17.317012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e821c7bf-2ca2-4c8e-9174-863abb5c078e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:17.317442 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e821c7bf-2ca2-4c8e-9174-863abb5c078e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:17.452071 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e821c7bf-2ca2-4c8e-9174-863abb5c078e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:17.460381 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-e821c7bf-2ca2-4c8e-9174-863abb5c078e tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1678 microversion: 2.1 time: 0.156442 May 16 20:46:17.460977 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 455/911] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:17 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:18.478209 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-3173e51d-f076-406f-9d07-948ab372569c tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:18.478929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-3173e51d-f076-406f-9d07-948ab372569c tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:18.487083 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3173e51d-f076-406f-9d07-948ab372569c tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:18.487538 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3173e51d-f076-406f-9d07-948ab372569c tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:18.488341 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3173e51d-f076-406f-9d07-948ab372569c tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:18.488805 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-3173e51d-f076-406f-9d07-948ab372569c tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:18.638303 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-3173e51d-f076-406f-9d07-948ab372569c tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:18.646070 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-3173e51d-f076-406f-9d07-948ab372569c tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1678 microversion: 2.1 time: 0.171993 May 16 20:46:18.646633 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 457/912] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:18 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:19.663344 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-170298fa-83ee-42f5-ad2a-a6f8575d7434 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:19.663962 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-170298fa-83ee-42f5-ad2a-a6f8575d7434 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:19.670836 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-170298fa-83ee-42f5-ad2a-a6f8575d7434 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:19.671287 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-170298fa-83ee-42f5-ad2a-a6f8575d7434 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:19.672065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-170298fa-83ee-42f5-ad2a-a6f8575d7434 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:19.672522 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-170298fa-83ee-42f5-ad2a-a6f8575d7434 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:19.827211 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-170298fa-83ee-42f5-ad2a-a6f8575d7434 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:19.835726 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-170298fa-83ee-42f5-ad2a-a6f8575d7434 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1678 microversion: 2.1 time: 0.176289 May 16 20:46:19.836311 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 456/913] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:19 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:20.857179 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-063262d6-0417-481f-9deb-7161edb3af24 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:20.858109 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-063262d6-0417-481f-9deb-7161edb3af24 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:20.869000 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-063262d6-0417-481f-9deb-7161edb3af24 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:20.869738 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-063262d6-0417-481f-9deb-7161edb3af24 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:20.870995 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-063262d6-0417-481f-9deb-7161edb3af24 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:20.871706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-063262d6-0417-481f-9deb-7161edb3af24 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:21.003966 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-063262d6-0417-481f-9deb-7161edb3af24 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:21.011451 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-063262d6-0417-481f-9deb-7161edb3af24 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1678 microversion: 2.1 time: 0.161044 May 16 20:46:21.011984 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 458/914] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:20 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:21.308303 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-05e4c4c5-9e6a-4e40-b6f3-7ff311f3bdbf tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:46:21.308897 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-05e4c4c5-9e6a-4e40-b6f3-7ff311f3bdbf tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:21.316684 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-05e4c4c5-9e6a-4e40-b6f3-7ff311f3bdbf tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:21.317182 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-05e4c4c5-9e6a-4e40-b6f3-7ff311f3bdbf tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:21.318058 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-05e4c4c5-9e6a-4e40-b6f3-7ff311f3bdbf tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:21.318530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-05e4c4c5-9e6a-4e40-b6f3-7ff311f3bdbf tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:21.346034 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.objects.instance [None req-05e4c4c5-9e6a-4e40-b6f3-7ff311f3bdbf tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lazy-loading 'flavor' on Instance uuid cd4c11b0-f517-4783-99ec-8a010cb5dbb8 {{(pid=123564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:46:21.422452 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-05e4c4c5-9e6a-4e40-b6f3-7ff311f3bdbf tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "POST /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8/action" status: 202 len: 0 microversion: 2.1 time: 0.119423 May 16 20:46:21.423037 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 457/915] 10.222.0.49 () {60 vars in 1277 bytes} [Mon May 16 20:46:21 2022] POST /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:46:21.431718 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-f013c0b6-58c9-4262-b347-be50bfc2d9dc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:21.432353 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-f013c0b6-58c9-4262-b347-be50bfc2d9dc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:21.438354 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f013c0b6-58c9-4262-b347-be50bfc2d9dc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:21.438785 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f013c0b6-58c9-4262-b347-be50bfc2d9dc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:21.439541 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f013c0b6-58c9-4262-b347-be50bfc2d9dc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:21.439964 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f013c0b6-58c9-4262-b347-be50bfc2d9dc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:21.569805 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-f013c0b6-58c9-4262-b347-be50bfc2d9dc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:21.577777 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-f013c0b6-58c9-4262-b347-be50bfc2d9dc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1567 microversion: 2.1 time: 0.150028 May 16 20:46:21.578315 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 459/916] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:21 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:22.033844 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-02d47a6f-0cd0-43ea-bb69-b87fbc940936 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:22.034996 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-02d47a6f-0cd0-43ea-bb69-b87fbc940936 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:22.045919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-02d47a6f-0cd0-43ea-bb69-b87fbc940936 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:22.046713 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-02d47a6f-0cd0-43ea-bb69-b87fbc940936 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:22.047954 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-02d47a6f-0cd0-43ea-bb69-b87fbc940936 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:22.048748 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-02d47a6f-0cd0-43ea-bb69-b87fbc940936 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:22.188572 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-02d47a6f-0cd0-43ea-bb69-b87fbc940936 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:22.196925 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-02d47a6f-0cd0-43ea-bb69-b87fbc940936 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1655 microversion: 2.1 time: 0.170145 May 16 20:46:22.197508 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 458/917] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:22 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1655 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:22.213222 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-6cbc1dda-9dca-41c4-9006-f6fbdaabddf2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:46:22.219640 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6cbc1dda-9dca-41c4-9006-f6fbdaabddf2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:22.220062 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6cbc1dda-9dca-41c4-9006-f6fbdaabddf2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:22.241912 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-6cbc1dda-9dca-41c4-9006-f6fbdaabddf2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Going to try to start instance {{(pid=123563) start /opt/stack/nova/nova/compute/api.py:2730}} May 16 20:46:22.289141 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-6cbc1dda-9dca-41c4-9006-f6fbdaabddf2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "POST /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040/action" status: 202 len: 0 microversion: 2.1 time: 0.079149 May 16 20:46:22.289815 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 460/918] 10.222.0.49 () {60 vars in 1277 bytes} [Mon May 16 20:46:22 2022] POST /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:46:22.297951 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-008da114-1814-4c13-b39b-795cbb1a2df3 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:22.298571 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-008da114-1814-4c13-b39b-795cbb1a2df3 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:22.304872 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-008da114-1814-4c13-b39b-795cbb1a2df3 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:22.305484 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-008da114-1814-4c13-b39b-795cbb1a2df3 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:22.306314 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-008da114-1814-4c13-b39b-795cbb1a2df3 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:22.306775 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-008da114-1814-4c13-b39b-795cbb1a2df3 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:22.471680 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-008da114-1814-4c13-b39b-795cbb1a2df3 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:22.479761 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-008da114-1814-4c13-b39b-795cbb1a2df3 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1664 microversion: 2.1 time: 0.185629 May 16 20:46:22.480458 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 459/919] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:22 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1664 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:22.596116 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-875ff7d3-46d7-4686-9a83-fd18f0f0b486 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:22.596854 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-875ff7d3-46d7-4686-9a83-fd18f0f0b486 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:22.604692 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-875ff7d3-46d7-4686-9a83-fd18f0f0b486 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:22.605141 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-875ff7d3-46d7-4686-9a83-fd18f0f0b486 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:22.605931 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-875ff7d3-46d7-4686-9a83-fd18f0f0b486 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:22.606520 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-875ff7d3-46d7-4686-9a83-fd18f0f0b486 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:22.820719 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-875ff7d3-46d7-4686-9a83-fd18f0f0b486 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:22.828683 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-875ff7d3-46d7-4686-9a83-fd18f0f0b486 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1567 microversion: 2.1 time: 0.236796 May 16 20:46:22.829261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 461/920] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:22 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:23.498262 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-c548eb7f-4211-4b3a-9a55-bdb0d6930461 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:23.498989 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-c548eb7f-4211-4b3a-9a55-bdb0d6930461 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:23.506471 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c548eb7f-4211-4b3a-9a55-bdb0d6930461 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:23.506946 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c548eb7f-4211-4b3a-9a55-bdb0d6930461 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:23.507693 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c548eb7f-4211-4b3a-9a55-bdb0d6930461 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:23.508126 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c548eb7f-4211-4b3a-9a55-bdb0d6930461 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:23.648506 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-c548eb7f-4211-4b3a-9a55-bdb0d6930461 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:23.656142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-c548eb7f-4211-4b3a-9a55-bdb0d6930461 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1668 microversion: 2.1 time: 0.162775 May 16 20:46:23.656779 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 460/921] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:23 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:23.850613 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2b723be7-d1f2-4e8e-91c9-bc0d9dce17ca tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:23.851490 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-2b723be7-d1f2-4e8e-91c9-bc0d9dce17ca tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:23.858863 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2b723be7-d1f2-4e8e-91c9-bc0d9dce17ca tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:23.859337 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2b723be7-d1f2-4e8e-91c9-bc0d9dce17ca tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:23.860148 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2b723be7-d1f2-4e8e-91c9-bc0d9dce17ca tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:23.860654 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2b723be7-d1f2-4e8e-91c9-bc0d9dce17ca tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:24.002909 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-2b723be7-d1f2-4e8e-91c9-bc0d9dce17ca tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:24.011036 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-2b723be7-d1f2-4e8e-91c9-bc0d9dce17ca tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1567 microversion: 2.1 time: 0.167120 May 16 20:46:24.011588 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 462/922] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:23 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:25.032744 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-759dae15-316f-4efa-ba6b-56469a791df4 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:25.033705 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-759dae15-316f-4efa-ba6b-56469a791df4 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:25.044702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-759dae15-316f-4efa-ba6b-56469a791df4 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:25.045458 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-759dae15-316f-4efa-ba6b-56469a791df4 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:25.046747 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-759dae15-316f-4efa-ba6b-56469a791df4 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:25.047513 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-759dae15-316f-4efa-ba6b-56469a791df4 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:25.182908 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-759dae15-316f-4efa-ba6b-56469a791df4 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:25.191192 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-759dae15-316f-4efa-ba6b-56469a791df4 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1567 microversion: 2.1 time: 0.165035 May 16 20:46:25.191760 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 461/923] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:25 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:26.211464 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-8bb02b53-e593-4379-8c7e-9e4708ca8cbc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:26.212328 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-8bb02b53-e593-4379-8c7e-9e4708ca8cbc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:26.222427 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8bb02b53-e593-4379-8c7e-9e4708ca8cbc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:26.223122 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8bb02b53-e593-4379-8c7e-9e4708ca8cbc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:26.224366 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8bb02b53-e593-4379-8c7e-9e4708ca8cbc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:26.225087 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8bb02b53-e593-4379-8c7e-9e4708ca8cbc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:26.356162 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-8bb02b53-e593-4379-8c7e-9e4708ca8cbc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:26.364334 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-8bb02b53-e593-4379-8c7e-9e4708ca8cbc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1567 microversion: 2.1 time: 0.158831 May 16 20:46:26.364942 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 463/924] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:26 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:27.382046 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-384f0ce9-8b0c-4d16-b8ae-a4179b55759b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:27.382657 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-384f0ce9-8b0c-4d16-b8ae-a4179b55759b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:27.390203 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-384f0ce9-8b0c-4d16-b8ae-a4179b55759b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:27.390648 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-384f0ce9-8b0c-4d16-b8ae-a4179b55759b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:27.391413 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-384f0ce9-8b0c-4d16-b8ae-a4179b55759b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:27.391860 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-384f0ce9-8b0c-4d16-b8ae-a4179b55759b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:27.526523 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-384f0ce9-8b0c-4d16-b8ae-a4179b55759b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:27.534285 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-384f0ce9-8b0c-4d16-b8ae-a4179b55759b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1567 microversion: 2.1 time: 0.156264 May 16 20:46:27.534840 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 462/925] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:27 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:28.555274 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-176c3488-1ff1-4776-afd9-eaf6029be4da tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:28.556371 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-176c3488-1ff1-4776-afd9-eaf6029be4da tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:28.567526 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-176c3488-1ff1-4776-afd9-eaf6029be4da tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:28.568215 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-176c3488-1ff1-4776-afd9-eaf6029be4da tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:28.569538 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-176c3488-1ff1-4776-afd9-eaf6029be4da tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:28.570280 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-176c3488-1ff1-4776-afd9-eaf6029be4da tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:28.712016 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-176c3488-1ff1-4776-afd9-eaf6029be4da tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:28.720304 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-176c3488-1ff1-4776-afd9-eaf6029be4da tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1567 microversion: 2.1 time: 0.171464 May 16 20:46:28.720906 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 464/926] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:28 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:29.747212 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-3db5023d-db07-4ee0-afa4-b135f08d25e1 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:29.748217 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-3db5023d-db07-4ee0-afa4-b135f08d25e1 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:29.758934 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3db5023d-db07-4ee0-afa4-b135f08d25e1 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:29.759682 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3db5023d-db07-4ee0-afa4-b135f08d25e1 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:29.760801 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3db5023d-db07-4ee0-afa4-b135f08d25e1 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:29.761227 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3db5023d-db07-4ee0-afa4-b135f08d25e1 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:29.899713 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3db5023d-db07-4ee0-afa4-b135f08d25e1 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:29.910786 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-3db5023d-db07-4ee0-afa4-b135f08d25e1 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1567 microversion: 2.1 time: 0.169732 May 16 20:46:29.911433 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 463/927] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:29 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:30.933814 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-a6100383-359e-403e-bb5a-47d54cda73c6 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:30.934917 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-a6100383-359e-403e-bb5a-47d54cda73c6 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:30.946068 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a6100383-359e-403e-bb5a-47d54cda73c6 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:30.946823 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a6100383-359e-403e-bb5a-47d54cda73c6 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:30.948106 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a6100383-359e-403e-bb5a-47d54cda73c6 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:30.948887 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a6100383-359e-403e-bb5a-47d54cda73c6 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:31.086188 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-a6100383-359e-403e-bb5a-47d54cda73c6 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:31.093866 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-a6100383-359e-403e-bb5a-47d54cda73c6 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1567 microversion: 2.1 time: 0.166550 May 16 20:46:31.094404 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 465/928] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:30 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:32.115608 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-4ac0ad2a-c23b-403a-97b2-e84500acfcf0 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:32.116302 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-4ac0ad2a-c23b-403a-97b2-e84500acfcf0 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:32.123175 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4ac0ad2a-c23b-403a-97b2-e84500acfcf0 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:32.123630 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4ac0ad2a-c23b-403a-97b2-e84500acfcf0 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:32.124401 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4ac0ad2a-c23b-403a-97b2-e84500acfcf0 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:32.124867 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4ac0ad2a-c23b-403a-97b2-e84500acfcf0 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:32.325298 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-4ac0ad2a-c23b-403a-97b2-e84500acfcf0 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:32.334715 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-4ac0ad2a-c23b-403a-97b2-e84500acfcf0 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1567 microversion: 2.1 time: 0.224169 May 16 20:46:32.335224 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 464/929] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:32 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:33.356055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-53d2401b-0372-462c-9b0f-a1dac8d16ae4 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:33.356642 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-53d2401b-0372-462c-9b0f-a1dac8d16ae4 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:33.363458 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-53d2401b-0372-462c-9b0f-a1dac8d16ae4 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:33.363911 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-53d2401b-0372-462c-9b0f-a1dac8d16ae4 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:33.364728 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-53d2401b-0372-462c-9b0f-a1dac8d16ae4 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:33.365164 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-53d2401b-0372-462c-9b0f-a1dac8d16ae4 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:33.516551 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-53d2401b-0372-462c-9b0f-a1dac8d16ae4 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:33.524517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-53d2401b-0372-462c-9b0f-a1dac8d16ae4 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1567 microversion: 2.1 time: 0.174896 May 16 20:46:33.525094 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 466/930] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:33 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:34.540924 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-d64b4ea8-77e8-4795-8d68-1f71519cd32e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:34.541518 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-d64b4ea8-77e8-4795-8d68-1f71519cd32e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:34.548142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d64b4ea8-77e8-4795-8d68-1f71519cd32e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:34.548618 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d64b4ea8-77e8-4795-8d68-1f71519cd32e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:34.549425 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d64b4ea8-77e8-4795-8d68-1f71519cd32e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:34.549858 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d64b4ea8-77e8-4795-8d68-1f71519cd32e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:34.681439 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-d64b4ea8-77e8-4795-8d68-1f71519cd32e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:34.689942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-d64b4ea8-77e8-4795-8d68-1f71519cd32e tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1568 microversion: 2.1 time: 0.152541 May 16 20:46:34.690554 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 465/931] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:34 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:34.706469 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-546d597e-46aa-493d-92a4-5cfd8a6c8a34 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:46:34.707015 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-546d597e-46aa-493d-92a4-5cfd8a6c8a34 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:34.713858 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-546d597e-46aa-493d-92a4-5cfd8a6c8a34 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:34.714310 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-546d597e-46aa-493d-92a4-5cfd8a6c8a34 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:34.715175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-546d597e-46aa-493d-92a4-5cfd8a6c8a34 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:34.715616 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-546d597e-46aa-493d-92a4-5cfd8a6c8a34 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:34.804688 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-546d597e-46aa-493d-92a4-5cfd8a6c8a34 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "POST /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8/action" status: 202 len: 0 microversion: 2.1 time: 0.101858 May 16 20:46:34.805575 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 467/932] 10.222.0.49 () {60 vars in 1277 bytes} [Mon May 16 20:46:34 2022] POST /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:46:34.815815 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-6e3302da-c09c-4eab-9639-3872c83dbd73 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:34.816712 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-6e3302da-c09c-4eab-9639-3872c83dbd73 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:34.822720 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6e3302da-c09c-4eab-9639-3872c83dbd73 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:34.823166 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6e3302da-c09c-4eab-9639-3872c83dbd73 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:34.823926 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6e3302da-c09c-4eab-9639-3872c83dbd73 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:34.824380 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-6e3302da-c09c-4eab-9639-3872c83dbd73 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:34.975256 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-6e3302da-c09c-4eab-9639-3872c83dbd73 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:34.982795 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-6e3302da-c09c-4eab-9639-3872c83dbd73 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1576 microversion: 2.1 time: 0.171287 May 16 20:46:34.983371 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 466/933] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:34 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:36.000390 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-c5beb69b-8a58-4fd1-87ae-f58d4298632b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:36.001109 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-c5beb69b-8a58-4fd1-87ae-f58d4298632b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:36.007442 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c5beb69b-8a58-4fd1-87ae-f58d4298632b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:36.007900 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c5beb69b-8a58-4fd1-87ae-f58d4298632b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:36.008702 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c5beb69b-8a58-4fd1-87ae-f58d4298632b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:36.009142 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c5beb69b-8a58-4fd1-87ae-f58d4298632b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:36.144612 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-c5beb69b-8a58-4fd1-87ae-f58d4298632b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:36.152719 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-c5beb69b-8a58-4fd1-87ae-f58d4298632b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1518 microversion: 2.1 time: 0.157299 May 16 20:46:36.153548 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 468/934] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:35 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:37.172129 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e87af8c9-74e8-44b3-adb5-06a5e6abf634 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:37.172788 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-e87af8c9-74e8-44b3-adb5-06a5e6abf634 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:37.179431 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e87af8c9-74e8-44b3-adb5-06a5e6abf634 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:37.179880 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e87af8c9-74e8-44b3-adb5-06a5e6abf634 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:37.180693 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e87af8c9-74e8-44b3-adb5-06a5e6abf634 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:37.181156 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e87af8c9-74e8-44b3-adb5-06a5e6abf634 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:37.313838 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e87af8c9-74e8-44b3-adb5-06a5e6abf634 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:37.324769 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-e87af8c9-74e8-44b3-adb5-06a5e6abf634 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1574 microversion: 2.1 time: 0.156745 May 16 20:46:37.325337 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 467/935] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:37 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:37.642501 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-7259c184-0685-4e05-821a-85538c605634 req-0a42e3fc-3f34-4c67-8b44-b033f387f8ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4c11b0-f517-4783-99ec-8a010cb5dbb8", "name": "network-vif-unplugged", "status": "completed", "tag": "29979fec-638a-4157-bbd7-3f1f941c944e"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:46:37.657243 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-7259c184-0685-4e05-821a-85538c605634 req-0a42e3fc-3f34-4c67-8b44-b033f387f8ad service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:37.658010 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-7259c184-0685-4e05-821a-85538c605634 req-0a42e3fc-3f34-4c67-8b44-b033f387f8ad service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:37.669740 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-7259c184-0685-4e05-821a-85538c605634 req-0a42e3fc-3f34-4c67-8b44-b033f387f8ad service nova] Creating event network-vif-unplugged:29979fec-638a-4157-bbd7-3f1f941c944e for instance cd4c11b0-f517-4783-99ec-8a010cb5dbb8 on hv-cinder-77703 May 16 20:46:37.674846 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-7259c184-0685-4e05-821a-85538c605634 req-0a42e3fc-3f34-4c67-8b44-b033f387f8ad service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038146 May 16 20:46:37.675471 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 469/936] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:46:38.346733 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-593944e8-2b02-405d-a437-fe3331bad99f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:38.348331 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-593944e8-2b02-405d-a437-fe3331bad99f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:38.359427 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-593944e8-2b02-405d-a437-fe3331bad99f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:38.360162 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-593944e8-2b02-405d-a437-fe3331bad99f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:38.361471 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-593944e8-2b02-405d-a437-fe3331bad99f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:38.362178 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-593944e8-2b02-405d-a437-fe3331bad99f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:38.680229 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-593944e8-2b02-405d-a437-fe3331bad99f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:38.688215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-593944e8-2b02-405d-a437-fe3331bad99f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1574 microversion: 2.1 time: 0.347996 May 16 20:46:38.688813 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 468/937] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:38 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1574 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:39.712404 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0b0e1e3c-dad0-49a1-b114-a36210e84639 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:39.713596 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0b0e1e3c-dad0-49a1-b114-a36210e84639 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:39.724196 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0b0e1e3c-dad0-49a1-b114-a36210e84639 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:39.724994 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0b0e1e3c-dad0-49a1-b114-a36210e84639 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:39.726272 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0b0e1e3c-dad0-49a1-b114-a36210e84639 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:39.726985 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0b0e1e3c-dad0-49a1-b114-a36210e84639 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:39.865507 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-0b0e1e3c-dad0-49a1-b114-a36210e84639 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:39.873889 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0b0e1e3c-dad0-49a1-b114-a36210e84639 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1574 microversion: 2.1 time: 0.169424 May 16 20:46:39.874455 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 470/938] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:39 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:40.892318 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-aa63f19d-8355-48f1-bbd6-3c05ce439ce9 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:40.892968 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-aa63f19d-8355-48f1-bbd6-3c05ce439ce9 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:40.901529 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-aa63f19d-8355-48f1-bbd6-3c05ce439ce9 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:40.902009 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-aa63f19d-8355-48f1-bbd6-3c05ce439ce9 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:40.902787 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-aa63f19d-8355-48f1-bbd6-3c05ce439ce9 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:40.903215 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-aa63f19d-8355-48f1-bbd6-3c05ce439ce9 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:41.038624 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-aa63f19d-8355-48f1-bbd6-3c05ce439ce9 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:41.047897 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-aa63f19d-8355-48f1-bbd6-3c05ce439ce9 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1574 microversion: 2.1 time: 0.159601 May 16 20:46:41.048476 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 469/939] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:40 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:42.069942 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-06b57cb1-d76f-40d8-8a76-e9c58af42b95 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:42.070809 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-06b57cb1-d76f-40d8-8a76-e9c58af42b95 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:42.081664 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-06b57cb1-d76f-40d8-8a76-e9c58af42b95 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:42.082422 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-06b57cb1-d76f-40d8-8a76-e9c58af42b95 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:42.083694 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-06b57cb1-d76f-40d8-8a76-e9c58af42b95 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:42.084414 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-06b57cb1-d76f-40d8-8a76-e9c58af42b95 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:42.230450 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-06b57cb1-d76f-40d8-8a76-e9c58af42b95 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:42.241591 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-06b57cb1-d76f-40d8-8a76-e9c58af42b95 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1574 microversion: 2.1 time: 0.178979 May 16 20:46:42.242346 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 471/940] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:42 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1574 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:43.259300 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-b42246d2-ffaa-4aed-80ff-dd40baecb20b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:43.259905 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-b42246d2-ffaa-4aed-80ff-dd40baecb20b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:43.266867 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b42246d2-ffaa-4aed-80ff-dd40baecb20b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:43.267316 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b42246d2-ffaa-4aed-80ff-dd40baecb20b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:43.268092 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b42246d2-ffaa-4aed-80ff-dd40baecb20b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:43.268551 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b42246d2-ffaa-4aed-80ff-dd40baecb20b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:43.414308 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-b42246d2-ffaa-4aed-80ff-dd40baecb20b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:43.421962 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-b42246d2-ffaa-4aed-80ff-dd40baecb20b tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1574 microversion: 2.1 time: 0.166569 May 16 20:46:43.422501 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 470/941] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:43 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:44.440866 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-5b51e067-0605-4bb8-9269-a7164aefc051 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:44.441572 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-5b51e067-0605-4bb8-9269-a7164aefc051 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:44.449085 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5b51e067-0605-4bb8-9269-a7164aefc051 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:44.449577 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5b51e067-0605-4bb8-9269-a7164aefc051 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:44.450437 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5b51e067-0605-4bb8-9269-a7164aefc051 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:44.450907 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5b51e067-0605-4bb8-9269-a7164aefc051 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:44.588803 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-5b51e067-0605-4bb8-9269-a7164aefc051 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:44.596968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-5b51e067-0605-4bb8-9269-a7164aefc051 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1561 microversion: 2.1 time: 0.160960 May 16 20:46:44.597514 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 472/942] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:44 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:47.722571 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-8ddfd6ae-8d73-47e9-b90b-622681781290 req-da743383-41f8-4f3d-bd36-6d3630a3c045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4c11b0-f517-4783-99ec-8a010cb5dbb8", "name": "network-vif-plugged", "status": "completed", "tag": "29979fec-638a-4157-bbd7-3f1f941c944e"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:46:47.732160 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-8ddfd6ae-8d73-47e9-b90b-622681781290 req-da743383-41f8-4f3d-bd36-6d3630a3c045 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:47.732648 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-8ddfd6ae-8d73-47e9-b90b-622681781290 req-da743383-41f8-4f3d-bd36-6d3630a3c045 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:47.745493 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-8ddfd6ae-8d73-47e9-b90b-622681781290 req-da743383-41f8-4f3d-bd36-6d3630a3c045 service nova] Creating event network-vif-plugged:29979fec-638a-4157-bbd7-3f1f941c944e for instance cd4c11b0-f517-4783-99ec-8a010cb5dbb8 on hv-cinder-77703 May 16 20:46:47.750716 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-8ddfd6ae-8d73-47e9-b90b-622681781290 req-da743383-41f8-4f3d-bd36-6d3630a3c045 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032080 May 16 20:46:47.751661 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 471/943] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:46:56.406370 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-a7f2a4df-116b-4115-9942-05a48adbd583 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:56.407339 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-a7f2a4df-116b-4115-9942-05a48adbd583 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:56.414111 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a7f2a4df-116b-4115-9942-05a48adbd583 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:56.414563 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a7f2a4df-116b-4115-9942-05a48adbd583 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:56.415334 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a7f2a4df-116b-4115-9942-05a48adbd583 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:56.415767 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-a7f2a4df-116b-4115-9942-05a48adbd583 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:56.451207 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-a7f2a4df-116b-4115-9942-05a48adbd583 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048900 May 16 20:46:56.451749 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 473/944] 10.222.0.49 () {58 vars in 1301 bytes} [Mon May 16 20:46:56 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 20:46:56.519132 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-c19b88f0-88e0-4adf-90aa-f75871f2f7c2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:56.519725 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-c19b88f0-88e0-4adf-90aa-f75871f2f7c2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:56.526704 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c19b88f0-88e0-4adf-90aa-f75871f2f7c2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:56.527155 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c19b88f0-88e0-4adf-90aa-f75871f2f7c2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:56.528055 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c19b88f0-88e0-4adf-90aa-f75871f2f7c2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:56.528511 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c19b88f0-88e0-4adf-90aa-f75871f2f7c2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:56.552843 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-c19b88f0-88e0-4adf-90aa-f75871f2f7c2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Going to try to terminate instance {{(pid=123564) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:46:56.570191 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 20:46:56.570388 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Mon May 16 20:46:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 20:46:56.644842 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-c19b88f0-88e0-4adf-90aa-f75871f2f7c2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 204 len: 0 microversion: 2.1 time: 0.129350 May 16 20:46:56.645655 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 472/945] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:46:56 2022] DELETE /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 20:46:56.654545 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-94035714-fde2-4322-892d-345cec7bd1ef tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:56.655257 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-94035714-fde2-4322-892d-345cec7bd1ef tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:56.661613 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-94035714-fde2-4322-892d-345cec7bd1ef tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:56.662061 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-94035714-fde2-4322-892d-345cec7bd1ef tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:56.662836 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-94035714-fde2-4322-892d-345cec7bd1ef tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:56.663267 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-94035714-fde2-4322-892d-345cec7bd1ef tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:56.855326 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-94035714-fde2-4322-892d-345cec7bd1ef tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:56.863269 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-94035714-fde2-4322-892d-345cec7bd1ef tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1674 microversion: 2.1 time: 0.212751 May 16 20:46:56.863848 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 474/946] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:56 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1674 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 20:46:57.885900 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-28c164cd-542a-42dd-b08c-e26517269a71 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:57.887150 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-28c164cd-542a-42dd-b08c-e26517269a71 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:57.897839 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-28c164cd-542a-42dd-b08c-e26517269a71 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:57.898568 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-28c164cd-542a-42dd-b08c-e26517269a71 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:57.899820 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-28c164cd-542a-42dd-b08c-e26517269a71 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:57.900546 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-28c164cd-542a-42dd-b08c-e26517269a71 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:58.082227 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-28c164cd-542a-42dd-b08c-e26517269a71 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:58.090445 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-28c164cd-542a-42dd-b08c-e26517269a71 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1674 microversion: 2.1 time: 0.211593 May 16 20:46:58.090975 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 473/947] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:57 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1674 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:59.115115 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-5961122e-8af5-4038-9450-432c63de30bd tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:46:59.115774 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-5961122e-8af5-4038-9450-432c63de30bd tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:46:59.124086 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5961122e-8af5-4038-9450-432c63de30bd tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:59.124547 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5961122e-8af5-4038-9450-432c63de30bd tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:59.125351 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5961122e-8af5-4038-9450-432c63de30bd tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:59.125786 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-5961122e-8af5-4038-9450-432c63de30bd tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:59.324821 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-5961122e-8af5-4038-9450-432c63de30bd tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:46:59.333399 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-5961122e-8af5-4038-9450-432c63de30bd tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 200 len: 1674 microversion: 2.1 time: 0.223253 May 16 20:46:59.334324 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 475/948] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:46:59 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 1674 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:46:59.651484 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-ee86a477-5443-4eb1-83e5-37829153ed55 req-43e7b737-7555-4ec9-9bc5-663328b1c1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a733942d-a211-4c45-9fcf-8eab9293e040", "name": "network-vif-deleted", "tag": "e9a3f0c7-3945-4332-8b0a-b5c43dc5c8a3"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:46:59.661018 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-ee86a477-5443-4eb1-83e5-37829153ed55 req-43e7b737-7555-4ec9-9bc5-663328b1c1b6 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:46:59.661574 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-ee86a477-5443-4eb1-83e5-37829153ed55 req-43e7b737-7555-4ec9-9bc5-663328b1c1b6 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:46:59.676778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-ee86a477-5443-4eb1-83e5-37829153ed55 req-43e7b737-7555-4ec9-9bc5-663328b1c1b6 service nova] Creating event network-vif-deleted:e9a3f0c7-3945-4332-8b0a-b5c43dc5c8a3 for instance a733942d-a211-4c45-9fcf-8eab9293e040 on hv-cinder-77703 May 16 20:46:59.681960 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-ee86a477-5443-4eb1-83e5-37829153ed55 req-43e7b737-7555-4ec9-9bc5-663328b1c1b6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036765 May 16 20:46:59.682797 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 474/949] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:47:00.351253 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-66cb0e03-bb9d-44e4-a5e4-141d047cbb86 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:00.352537 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-66cb0e03-bb9d-44e4-a5e4-141d047cbb86 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:00.359100 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-66cb0e03-bb9d-44e4-a5e4-141d047cbb86 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:00.359546 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-66cb0e03-bb9d-44e4-a5e4-141d047cbb86 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:00.360324 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-66cb0e03-bb9d-44e4-a5e4-141d047cbb86 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:00.360953 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-66cb0e03-bb9d-44e4-a5e4-141d047cbb86 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:00.374563 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-66cb0e03-bb9d-44e4-a5e4-141d047cbb86 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] HTTP exception thrown: Instance a733942d-a211-4c45-9fcf-8eab9293e040 could not be found. May 16 20:47:00.376239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-66cb0e03-bb9d-44e4-a5e4-141d047cbb86 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Request method failure captured: May 16 20:47:00.376239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 HTTP/1.1 May 16 20:47:00.376239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:47:00.376239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:47:00.376239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:47:00.376239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:47:00.376239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:47:00.376239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:47:00.376239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:47:00.376239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:47:00.376239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigreQLklr4DXQi-sF5R2oygn5cPcRQq3IyXejx5isxnYmdM5DA4CSAzE0cJqoNzTPZuoQg9tZ4gnseGVwsuKV9T1Az8MEDxAP-5CLU2rxE2PXhsqm49sRkUlcxxhF5N3I_akRNI8ncdYPZ_QM0QWud66Aid-K7zfnspaS14uOY0Cy4Cg May 16 20:47:00.376239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:47:00.376239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:47:00.376239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:47:00.376239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:47:00.376239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:47:00.376239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:47:00.376239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 1ccbb9b8d11b499cb9e84da27dd464e6 May 16 20:47:00.376239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-AttachVolumeTestJSON-1169807290 May 16 20:47:00.376239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:47:00.376239 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:47:00.378033 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1ccbb9b8d11b499cb9e84da27dd464e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ccbb9b8d11b499cb9e84da27dd464e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1ccbb9b8d11b499cb9e84da27dd464e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ccbb9b8d11b499cb9e84da27dd464e6"}]}] May 16 20:47:00.378033 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-AttachVolumeTestJSON-1169807290 May 16 20:47:00.378033 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 1ccbb9b8d11b499cb9e84da27dd464e6 May 16 20:47:00.378033 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1169807290 May 16 20:47:00.378033 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-AttachVolumeTestJSON-1169807290-project May 16 20:47:00.378033 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:47:00.378033 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:47:00.378033 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: 0e56ccc11ac043af908dbfe3a10c9a55 May 16 20:47:00.378033 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-AttachVolumeTestJSON-1169807290-project May 16 20:47:00.378033 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: > May 16 20:47:00.378033 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Instance a733942d-a211-4c45-9fcf-8eab9293e040 could not be found. May 16 20:47:00.378033 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': 'a733942d-a211-4c45-9fcf-8eab9293e040'} May 16 20:47:00.382417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:47:00.382417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:47:00.382417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:47:00.382417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:47:00.382417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:47:00.382417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:47:00.382417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:47:00.382417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:47:00.382417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:47:00.382417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:47:00.382417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a733942d-a211-4c45-9fcf-8eab9293e040 could not be found. May 16 20:47:00.382417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:47:00.382417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:47:00.382417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:47:00.382417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:47:00.382417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:47:00.382417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:47:00.382417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:47:00.382417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:47:00.382417 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:47:00.384151 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:47:00.384151 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:47:00.384151 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:47:00.384151 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:47:00.384151 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:47:00.384151 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:47:00.384151 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:47:00.384151 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a733942d-a211-4c45-9fcf-8eab9293e040 could not be found. May 16 20:47:00.384151 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:47:00.384151 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:47:00.384151 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:47:00.384151 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:47:00.384151 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:47:00.384151 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:47:00.384151 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:47:00.384151 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:47:00.384151 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a733942d-a211-4c45-9fcf-8eab9293e040 could not be found. May 16 20:47:00.384151 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:47:00.385787 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-66cb0e03-bb9d-44e4-a5e4-141d047cbb86 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Returning 404 to user: Instance a733942d-a211-4c45-9fcf-8eab9293e040 could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:47:00.385787 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-66cb0e03-bb9d-44e4-a5e4-141d047cbb86 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 404 len: 111 microversion: 2.1 time: 0.030297 May 16 20:47:00.385787 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 476/950] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:47:00 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 20:47:00.387246 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-43c3c991-96df-4a20-8c1a-302915b11873 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '.version_select at 0x7f81b0f8f8b0>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:00.410286 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-43c3c991-96df-4a20-8c1a-302915b11873 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1264121086" status: 202 len: 0 microversion: 2.1 time: 0.027214 May 16 20:47:00.410864 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 475/951] 10.222.0.49 () {58 vars in 1220 bytes} [Mon May 16 20:47:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1264121086 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:47:01.043706 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-204afe1f-e1ee-4a30-9a02-86c20c9ca749 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Action: 'create', calling method: .version_select at 0x7f81b100c700>, body: {"keypair": {"name": "tempest-keypair-1572861697", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNo+SG9YiWJQ0vKnU+GqvACvRdmUobZ7s7saW2RQ/6/buQ2j6IVzqpKWRIZ/nmt6W3CrtGHJ9SMPS2n09OIbbfKbDb2Xu5zeWyeVjm8Php72+3F8hAhC9FfkJVdAAib3lA=="}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:47:01.057622 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-204afe1f-e1ee-4a30-9a02-86c20c9ca749 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Getting quotas for project 1ccbb9b8d11b499cb9e84da27dd464e6. Resources: {'key_pairs'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:47:01.061565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-204afe1f-e1ee-4a30-9a02-86c20c9ca749 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Getting quotas for user 0e56ccc11ac043af908dbfe3a10c9a55 and project 1ccbb9b8d11b499cb9e84da27dd464e6. Resources: {'key_pairs'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:47:01.086961 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-204afe1f-e1ee-4a30-9a02-86c20c9ca749 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047320 May 16 20:47:01.087521 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 477/952] 10.222.0.49 () {60 vars in 1158 bytes} [Mon May 16 20:47:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:47:01.976284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 16 20:47:01.976899 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Mon May 16 20:47:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 20:47:02.377547 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-627cae2d-5337-441a-aefc-1636ed9db311 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-759804880", "imageRef": "f9826e12-1d0c-4a5a-9616-338520403016", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8dc5c47-0d7f-4f3f-bbe1-95454b576a47"}], "security_groups": [{"name": "tempest-securitygroup--991046696"}], "key_name": "tempest-keypair-1572861697", "user_data": "}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:47:02.478524 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.network.neutron [None req-627cae2d-5337-441a-aefc-1636ed9db311 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] validate_networks() for [('f8dc5c47-0d7f-4f3f-bbe1-95454b576a47', None, None, None, None, None)] {{(pid=123564) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:47:02.852522 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-627cae2d-5337-441a-aefc-1636ed9db311 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Flavor limits 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:47:02.852979 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-627cae2d-5337-441a-aefc-1636ed9db311 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Image limits 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:47:02.853469 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-627cae2d-5337-441a-aefc-1636ed9db311 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Flavor pref 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:47:02.853891 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-627cae2d-5337-441a-aefc-1636ed9db311 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Image pref 0:0:0 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:47:02.854307 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.virt.hardware [None req-627cae2d-5337-441a-aefc-1636ed9db311 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:47:02.863928 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-627cae2d-5337-441a-aefc-1636ed9db311 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:02.864374 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-627cae2d-5337-441a-aefc-1636ed9db311 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:02.865210 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-627cae2d-5337-441a-aefc-1636ed9db311 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:02.865653 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-627cae2d-5337-441a-aefc-1636ed9db311 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:02.883466 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-627cae2d-5337-441a-aefc-1636ed9db311 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Getting quotas for project 1ccbb9b8d11b499cb9e84da27dd464e6. Resources: {'cores', 'ram', 'instances'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:47:02.887714 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.quota [None req-627cae2d-5337-441a-aefc-1636ed9db311 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Getting quotas for user 0e56ccc11ac043af908dbfe3a10c9a55 and project 1ccbb9b8d11b499cb9e84da27dd464e6. Resources: {'cores', 'ram', 'instances'} {{(pid=123564) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:47:02.899327 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-627cae2d-5337-441a-aefc-1636ed9db311 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Going to run 1 instances... {{(pid=123564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:47:02.901805 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-627cae2d-5337-441a-aefc-1636ed9db311 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9826e12-1d0c-4a5a-9616-338520403016',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:47:02.951331 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-627cae2d-5337-441a-aefc-1636ed9db311 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.578461 May 16 20:47:02.951899 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 476/953] 10.222.0.49 () {60 vars in 1146 bytes} [Mon May 16 20:47:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 20:47:02.962484 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-8f018afb-f4a0-4ee2-a1d8-3b027b2e50a9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:02.963091 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-8f018afb-f4a0-4ee2-a1d8-3b027b2e50a9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:03.020549 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-8f018afb-f4a0-4ee2-a1d8-3b027b2e50a9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:47:03.029695 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-8f018afb-f4a0-4ee2-a1d8-3b027b2e50a9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710" status: 200 len: 1237 microversion: 2.1 time: 0.071495 May 16 20:47:03.030277 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 478/954] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:47:02 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710 => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:47:03.356385 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-ed2ce897-042f-49c8-b9e4-8d8f8cc7bbc5 req-a5c3b568-09e6-4713-abbb-18bceee01bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "117d359a-7af9-46f0-bffb-d12ad46a929f", "tag": "996a4b17-c006-48b9-b68b-6329ea3a6c7a"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:47:03.357102 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-5111d2f5-5661-4361-a3e6-60ddf7f3a443 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:03.357695 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-5111d2f5-5661-4361-a3e6-60ddf7f3a443 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:03.365387 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5111d2f5-5661-4361-a3e6-60ddf7f3a443 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:03.365960 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5111d2f5-5661-4361-a3e6-60ddf7f3a443 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:03.366871 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5111d2f5-5661-4361-a3e6-60ddf7f3a443 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:03.367409 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5111d2f5-5661-4361-a3e6-60ddf7f3a443 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:03.377019 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-ed2ce897-042f-49c8-b9e4-8d8f8cc7bbc5 req-a5c3b568-09e6-4713-abbb-18bceee01bf5 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:03.377695 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-ed2ce897-042f-49c8-b9e4-8d8f8cc7bbc5 req-a5c3b568-09e6-4713-abbb-18bceee01bf5 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:03.394368 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-ed2ce897-042f-49c8-b9e4-8d8f8cc7bbc5 req-a5c3b568-09e6-4713-abbb-18bceee01bf5 service nova] Creating event network-changed:996a4b17-c006-48b9-b68b-6329ea3a6c7a for instance 117d359a-7af9-46f0-bffb-d12ad46a929f on hv-cinder-77703 May 16 20:47:03.396073 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-5111d2f5-5661-4361-a3e6-60ddf7f3a443 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] Going to try to terminate instance {{(pid=123564) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:47:03.400084 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-ed2ce897-042f-49c8-b9e4-8d8f8cc7bbc5 req-a5c3b568-09e6-4713-abbb-18bceee01bf5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047677 May 16 20:47:03.401349 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 479/955] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:47:03.507947 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-5111d2f5-5661-4361-a3e6-60ddf7f3a443 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "DELETE /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f" status: 204 len: 0 microversion: 2.1 time: 0.156514 May 16 20:47:03.508689 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 477/956] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:47:03 2022] DELETE /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 20:47:03.521251 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-026c5fd9-dba1-4423-b4fb-bc7ba5716102 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:03.522023 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-026c5fd9-dba1-4423-b4fb-bc7ba5716102 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:03.528701 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-026c5fd9-dba1-4423-b4fb-bc7ba5716102 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:03.529285 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-026c5fd9-dba1-4423-b4fb-bc7ba5716102 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:03.530166 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-026c5fd9-dba1-4423-b4fb-bc7ba5716102 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:03.530695 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-026c5fd9-dba1-4423-b4fb-bc7ba5716102 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:03.664884 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-026c5fd9-dba1-4423-b4fb-bc7ba5716102 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:47:03.672735 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-026c5fd9-dba1-4423-b4fb-bc7ba5716102 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f" status: 200 len: 1579 microversion: 2.1 time: 0.157877 May 16 20:47:03.673380 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 480/957] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:47:03 2022] GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f => generated 1579 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:47:04.047863 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-12d726c6-0190-49e2-b0bd-de94e8506737 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:04.048468 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-12d726c6-0190-49e2-b0bd-de94e8506737 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:04.054720 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-12d726c6-0190-49e2-b0bd-de94e8506737 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:04.055197 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-12d726c6-0190-49e2-b0bd-de94e8506737 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:04.055948 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-12d726c6-0190-49e2-b0bd-de94e8506737 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:04.056379 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-12d726c6-0190-49e2-b0bd-de94e8506737 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:04.118018 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-12d726c6-0190-49e2-b0bd-de94e8506737 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:47:04.125412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-12d726c6-0190-49e2-b0bd-de94e8506737 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710" status: 200 len: 1289 microversion: 2.1 time: 0.082175 May 16 20:47:04.125995 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 478/958] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:47:04 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710 => generated 1289 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:47:04.690553 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-dd4a18c6-25a3-41de-ae17-bf26b63ea9e3 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:04.691287 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-dd4a18c6-25a3-41de-ae17-bf26b63ea9e3 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:04.697853 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dd4a18c6-25a3-41de-ae17-bf26b63ea9e3 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:04.698304 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dd4a18c6-25a3-41de-ae17-bf26b63ea9e3 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:04.699076 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dd4a18c6-25a3-41de-ae17-bf26b63ea9e3 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:04.699517 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dd4a18c6-25a3-41de-ae17-bf26b63ea9e3 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:04.832163 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-dd4a18c6-25a3-41de-ae17-bf26b63ea9e3 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:47:04.844328 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-dd4a18c6-25a3-41de-ae17-bf26b63ea9e3 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f" status: 200 len: 1579 microversion: 2.1 time: 0.157724 May 16 20:47:04.845117 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 481/959] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:47:04 2022] GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:47:05.141893 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a2cbd313-2dd5-4f0d-9fe6-6d2dc1d84668 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:05.142515 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-a2cbd313-2dd5-4f0d-9fe6-6d2dc1d84668 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:05.149121 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a2cbd313-2dd5-4f0d-9fe6-6d2dc1d84668 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:05.149572 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a2cbd313-2dd5-4f0d-9fe6-6d2dc1d84668 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:05.150354 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a2cbd313-2dd5-4f0d-9fe6-6d2dc1d84668 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:05.150811 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a2cbd313-2dd5-4f0d-9fe6-6d2dc1d84668 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:05.264007 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a2cbd313-2dd5-4f0d-9fe6-6d2dc1d84668 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:47:05.272336 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-a2cbd313-2dd5-4f0d-9fe6-6d2dc1d84668 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710" status: 200 len: 1307 microversion: 2.1 time: 0.134438 May 16 20:47:05.274777 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 479/960] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:47:05 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710 => generated 1307 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:47:05.708396 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-d78197b8-4040-48b1-b5dc-ac249a21a83b req-5436bd8a-2015-47f2-b3c8-a4da01114671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "117d359a-7af9-46f0-bffb-d12ad46a929f", "name": "network-vif-deleted", "tag": "996a4b17-c006-48b9-b68b-6329ea3a6c7a"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:47:05.720086 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-d78197b8-4040-48b1-b5dc-ac249a21a83b req-5436bd8a-2015-47f2-b3c8-a4da01114671 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:05.720888 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-d78197b8-4040-48b1-b5dc-ac249a21a83b req-5436bd8a-2015-47f2-b3c8-a4da01114671 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:05.734396 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-d78197b8-4040-48b1-b5dc-ac249a21a83b req-5436bd8a-2015-47f2-b3c8-a4da01114671 service nova] Creating event network-vif-deleted:996a4b17-c006-48b9-b68b-6329ea3a6c7a for instance 117d359a-7af9-46f0-bffb-d12ad46a929f on hv-cinder-77703 May 16 20:47:05.740405 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-d78197b8-4040-48b1-b5dc-ac249a21a83b req-5436bd8a-2015-47f2-b3c8-a4da01114671 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037136 May 16 20:47:05.741136 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 482/961] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:47:05.864665 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-b0f34b1e-9979-4577-8108-bd4409e80e70 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:05.865272 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-b0f34b1e-9979-4577-8108-bd4409e80e70 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:05.871501 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b0f34b1e-9979-4577-8108-bd4409e80e70 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:05.871957 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b0f34b1e-9979-4577-8108-bd4409e80e70 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:05.872846 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b0f34b1e-9979-4577-8108-bd4409e80e70 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:05.873284 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b0f34b1e-9979-4577-8108-bd4409e80e70 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:05.977772 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-b0f34b1e-9979-4577-8108-bd4409e80e70 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:47:05.987017 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-b0f34b1e-9979-4577-8108-bd4409e80e70 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f" status: 200 len: 1226 microversion: 2.1 time: 0.126245 May 16 20:47:05.997145 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 480/962] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:47:05 2022] GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f => generated 1226 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:47:06.292252 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-8d146bb6-c0be-4e95-9028-3245303d98c0 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:06.296603 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-8d146bb6-c0be-4e95-9028-3245303d98c0 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:06.303308 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8d146bb6-c0be-4e95-9028-3245303d98c0 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:06.305098 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8d146bb6-c0be-4e95-9028-3245303d98c0 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:06.306001 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8d146bb6-c0be-4e95-9028-3245303d98c0 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:06.306440 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-8d146bb6-c0be-4e95-9028-3245303d98c0 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:06.501540 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-8d146bb6-c0be-4e95-9028-3245303d98c0 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:47:06.509003 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-8d146bb6-c0be-4e95-9028-3245303d98c0 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710" status: 200 len: 1362 microversion: 2.1 time: 0.221435 May 16 20:47:06.509580 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 483/963] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:47:06 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:47:07.003492 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-49492f27-eeae-4d5a-9963-4df43b196124 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:07.004097 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-49492f27-eeae-4d5a-9963-4df43b196124 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 117d359a-7af9-46f0-bffb-d12ad46a929f] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:07.011281 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-49492f27-eeae-4d5a-9963-4df43b196124 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:07.011736 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-49492f27-eeae-4d5a-9963-4df43b196124 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:07.012667 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-49492f27-eeae-4d5a-9963-4df43b196124 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:07.013519 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-49492f27-eeae-4d5a-9963-4df43b196124 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:07.033365 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-49492f27-eeae-4d5a-9963-4df43b196124 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] HTTP exception thrown: Instance 117d359a-7af9-46f0-bffb-d12ad46a929f could not be found. May 16 20:47:07.035531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-49492f27-eeae-4d5a-9963-4df43b196124 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Request method failure captured: May 16 20:47:07.035531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f HTTP/1.1 May 16 20:47:07.035531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:47:07.035531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:47:07.035531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:47:07.035531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:47:07.035531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:47:07.035531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:47:07.035531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:47:07.035531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:47:07.035531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrZ5Vc8NXooCBCmkZo1tt1PldAz_yBfVhqkVEQlj9Qe9yg3qoQ_NmEZiM2PJpp5v3dKhyxQqNUbimeMcM8ilnX6R-suhozFP71ObYN3jw-b4qBQALQLxrghC1T2tYosx42QkJ-eoJbqIfSEDBO0UbmHhsldlNHt5ZpSE3_D4WGGf8xY May 16 20:47:07.035531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:47:07.035531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:47:07.035531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:47:07.035531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:47:07.035531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:47:07.035531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:47:07.035531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 710ecde5160640149c693e0c2b0b0354 May 16 20:47:07.035531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-TestVolumeBootPattern-1176723552 May 16 20:47:07.035531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:47:07.035531 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:47:07.037108 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_710ecde5160640149c693e0c2b0b0354"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/710ecde5160640149c693e0c2b0b0354"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/710ecde5160640149c693e0c2b0b0354"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/710ecde5160640149c693e0c2b0b0354"}]}] May 16 20:47:07.037108 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-TestVolumeBootPattern-1176723552 May 16 20:47:07.037108 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 710ecde5160640149c693e0c2b0b0354 May 16 20:47:07.037108 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-TestVolumeBootPattern-1176723552 May 16 20:47:07.037108 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-TestVolumeBootPattern-1176723552-project May 16 20:47:07.037108 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:47:07.037108 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:47:07.037108 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: 6fa431ce09e44b85b61af972bbce2ed4 May 16 20:47:07.037108 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-TestVolumeBootPattern-1176723552-project May 16 20:47:07.037108 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:47:07.037108 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance 117d359a-7af9-46f0-bffb-d12ad46a929f could not be found. May 16 20:47:07.037108 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': '117d359a-7af9-46f0-bffb-d12ad46a929f'} May 16 20:47:07.037922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:47:07.037922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:47:07.037922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:47:07.037922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:47:07.037922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:47:07.037922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:47:07.037922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:47:07.037922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:47:07.037922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:47:07.037922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:47:07.037922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 117d359a-7af9-46f0-bffb-d12ad46a929f could not be found. May 16 20:47:07.037922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:47:07.037922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:47:07.037922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:47:07.037922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:47:07.037922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:47:07.037922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:47:07.037922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:47:07.037922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:47:07.037922 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:47:07.039205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:47:07.039205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:47:07.039205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:47:07.039205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:47:07.039205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:47:07.039205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:47:07.039205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:47:07.039205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 117d359a-7af9-46f0-bffb-d12ad46a929f could not be found. May 16 20:47:07.039205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:47:07.039205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:47:07.039205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:47:07.039205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:47:07.039205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:47:07.039205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:47:07.039205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:47:07.039205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:47:07.039205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 117d359a-7af9-46f0-bffb-d12ad46a929f could not be found. May 16 20:47:07.039205 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:47:07.040332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-49492f27-eeae-4d5a-9963-4df43b196124 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Returning 404 to user: Instance 117d359a-7af9-46f0-bffb-d12ad46a929f could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:47:07.040332 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-49492f27-eeae-4d5a-9963-4df43b196124 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f" status: 404 len: 111 microversion: 2.1 time: 0.037640 May 16 20:47:07.042621 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 481/964] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:47:06 2022] GET /compute/v2.1/servers/117d359a-7af9-46f0-bffb-d12ad46a929f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:47:07.086614 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-dba853b8-66b3-4adb-941d-9eb7940e3483 req-2c79c599-46d5-4f32-8b85-1a99f27c6fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bab26b8b-0542-432f-80bd-0a4b1c794710", "tag": "1d4eb15e-004d-4aa1-9411-88ac26950424"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:47:07.096720 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-dba853b8-66b3-4adb-941d-9eb7940e3483 req-2c79c599-46d5-4f32-8b85-1a99f27c6fd9 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:07.097307 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-dba853b8-66b3-4adb-941d-9eb7940e3483 req-2c79c599-46d5-4f32-8b85-1a99f27c6fd9 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:07.119634 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-dba853b8-66b3-4adb-941d-9eb7940e3483 req-2c79c599-46d5-4f32-8b85-1a99f27c6fd9 service nova] Creating event network-changed:1d4eb15e-004d-4aa1-9411-88ac26950424 for instance bab26b8b-0542-432f-80bd-0a4b1c794710 on hv-cinder-77703 May 16 20:47:07.129313 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-dba853b8-66b3-4adb-941d-9eb7940e3483 req-2c79c599-46d5-4f32-8b85-1a99f27c6fd9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043043 May 16 20:47:07.130304 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 484/965] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:47:07.526806 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e5dd66c1-37ce-4033-9304-2dfb2f4d5475 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:07.527547 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-e5dd66c1-37ce-4033-9304-2dfb2f4d5475 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:07.534305 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e5dd66c1-37ce-4033-9304-2dfb2f4d5475 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:07.534770 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e5dd66c1-37ce-4033-9304-2dfb2f4d5475 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:07.535515 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e5dd66c1-37ce-4033-9304-2dfb2f4d5475 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:07.535957 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e5dd66c1-37ce-4033-9304-2dfb2f4d5475 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:07.673701 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e5dd66c1-37ce-4033-9304-2dfb2f4d5475 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:47:07.681261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-e5dd66c1-37ce-4033-9304-2dfb2f4d5475 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710" status: 200 len: 1362 microversion: 2.1 time: 0.158934 May 16 20:47:07.681810 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 482/966] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:47:07 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:47:08.700686 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-89197360-3a44-47d7-a11a-b6036f02fec2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:08.701385 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-89197360-3a44-47d7-a11a-b6036f02fec2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:08.708011 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-89197360-3a44-47d7-a11a-b6036f02fec2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:08.708470 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-89197360-3a44-47d7-a11a-b6036f02fec2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:08.709244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-89197360-3a44-47d7-a11a-b6036f02fec2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:08.709669 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-89197360-3a44-47d7-a11a-b6036f02fec2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:08.899562 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-89197360-3a44-47d7-a11a-b6036f02fec2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:47:08.907628 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-89197360-3a44-47d7-a11a-b6036f02fec2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710" status: 200 len: 1362 microversion: 2.1 time: 0.211774 May 16 20:47:08.908418 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 485/967] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:47:08 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:47:09.926183 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-80d48359-f6c4-41ed-a287-2da604337cfc tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:09.927177 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-80d48359-f6c4-41ed-a287-2da604337cfc tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:09.934322 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-80d48359-f6c4-41ed-a287-2da604337cfc tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:09.934761 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-80d48359-f6c4-41ed-a287-2da604337cfc tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:09.935908 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-80d48359-f6c4-41ed-a287-2da604337cfc tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:09.936337 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-80d48359-f6c4-41ed-a287-2da604337cfc tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:10.157903 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-80d48359-f6c4-41ed-a287-2da604337cfc tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:47:10.167029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-80d48359-f6c4-41ed-a287-2da604337cfc tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710" status: 200 len: 1362 microversion: 2.1 time: 0.244381 May 16 20:47:10.167612 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 483/968] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:47:09 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:47:10.250956 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-7aff2df1-9379-477c-b5d4-d21005b64afc req-b5e57313-316b-4e51-a9b8-3b1f32742a3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e0412e9-a238-47bb-8e08-de4a723b74f1", "tag": "38516439-bbc9-4e23-9ca0-a93ad3f94ec1"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:47:10.254130 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-efdfb6aa-c058-4ce4-b1ce-22ffd9256a9c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:10.255241 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-efdfb6aa-c058-4ce4-b1ce-22ffd9256a9c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:10.261013 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-7aff2df1-9379-477c-b5d4-d21005b64afc req-b5e57313-316b-4e51-a9b8-3b1f32742a3f service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:10.261739 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-7aff2df1-9379-477c-b5d4-d21005b64afc req-b5e57313-316b-4e51-a9b8-3b1f32742a3f service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:10.262251 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-efdfb6aa-c058-4ce4-b1ce-22ffd9256a9c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:10.262716 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-efdfb6aa-c058-4ce4-b1ce-22ffd9256a9c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:10.263520 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-efdfb6aa-c058-4ce4-b1ce-22ffd9256a9c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:10.263991 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-efdfb6aa-c058-4ce4-b1ce-22ffd9256a9c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:10.273827 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-7aff2df1-9379-477c-b5d4-d21005b64afc req-b5e57313-316b-4e51-a9b8-3b1f32742a3f service nova] Creating event network-changed:38516439-bbc9-4e23-9ca0-a93ad3f94ec1 for instance 0e0412e9-a238-47bb-8e08-de4a723b74f1 on hv-cinder-77703 May 16 20:47:10.279180 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-7aff2df1-9379-477c-b5d4-d21005b64afc req-b5e57313-316b-4e51-a9b8-3b1f32742a3f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032661 May 16 20:47:10.280144 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 484/969] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:47:10.289840 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-efdfb6aa-c058-4ce4-b1ce-22ffd9256a9c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Going to try to terminate instance {{(pid=123563) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:47:10.372474 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-efdfb6aa-c058-4ce4-b1ce-22ffd9256a9c tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 204 len: 0 microversion: 2.1 time: 0.130831 May 16 20:47:10.374138 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 486/970] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:47:10 2022] DELETE /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 20:47:10.382268 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-c436cbb2-747e-420a-b0b9-20b06aaeaf39 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:10.382988 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-c436cbb2-747e-420a-b0b9-20b06aaeaf39 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:10.389607 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c436cbb2-747e-420a-b0b9-20b06aaeaf39 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:10.390110 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c436cbb2-747e-420a-b0b9-20b06aaeaf39 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:10.391075 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c436cbb2-747e-420a-b0b9-20b06aaeaf39 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:10.391323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c436cbb2-747e-420a-b0b9-20b06aaeaf39 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:10.538315 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-c436cbb2-747e-420a-b0b9-20b06aaeaf39 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:47:10.545978 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-c436cbb2-747e-420a-b0b9-20b06aaeaf39 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1579 microversion: 2.1 time: 0.167921 May 16 20:47:10.546505 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 485/971] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:47:10 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1579 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:47:11.183949 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-31aecebc-75c3-4534-a5b0-89df928ad9fb tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:11.184688 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-31aecebc-75c3-4534-a5b0-89df928ad9fb tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:11.191509 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-31aecebc-75c3-4534-a5b0-89df928ad9fb tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:11.191937 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-31aecebc-75c3-4534-a5b0-89df928ad9fb tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:11.192754 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-31aecebc-75c3-4534-a5b0-89df928ad9fb tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:11.193187 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-31aecebc-75c3-4534-a5b0-89df928ad9fb tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:11.332804 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-31aecebc-75c3-4534-a5b0-89df928ad9fb tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:47:11.340544 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-31aecebc-75c3-4534-a5b0-89df928ad9fb tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710" status: 200 len: 1362 microversion: 2.1 time: 0.160861 May 16 20:47:11.341116 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 487/972] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:47:11 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:47:11.568512 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-bbe05897-6cb9-4f7a-9c09-c95b74827d88 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:11.569571 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-bbe05897-6cb9-4f7a-9c09-c95b74827d88 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:11.578851 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bbe05897-6cb9-4f7a-9c09-c95b74827d88 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:11.579300 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bbe05897-6cb9-4f7a-9c09-c95b74827d88 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:11.580107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bbe05897-6cb9-4f7a-9c09-c95b74827d88 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:11.580577 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-bbe05897-6cb9-4f7a-9c09-c95b74827d88 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:11.780358 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-bbe05897-6cb9-4f7a-9c09-c95b74827d88 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:47:11.788069 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-bbe05897-6cb9-4f7a-9c09-c95b74827d88 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1579 microversion: 2.1 time: 0.226480 May 16 20:47:11.798429 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 486/973] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:47:11 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1579 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:47:11.819301 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-dd9fc6a1-dde6-4800-b93b-28e0240ac6f9 req-117623f8-933c-4007-86d8-cef8635af7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab26b8b-0542-432f-80bd-0a4b1c794710", "name": "network-vif-plugged", "status": "completed", "tag": "1d4eb15e-004d-4aa1-9411-88ac26950424"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:47:11.829486 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-dd9fc6a1-dde6-4800-b93b-28e0240ac6f9 req-117623f8-933c-4007-86d8-cef8635af7e1 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:11.829486 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-dd9fc6a1-dde6-4800-b93b-28e0240ac6f9 req-117623f8-933c-4007-86d8-cef8635af7e1 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:11.842613 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-dd9fc6a1-dde6-4800-b93b-28e0240ac6f9 req-117623f8-933c-4007-86d8-cef8635af7e1 service nova] Creating event network-vif-plugged:1d4eb15e-004d-4aa1-9411-88ac26950424 for instance bab26b8b-0542-432f-80bd-0a4b1c794710 on hv-cinder-77703 May 16 20:47:11.847498 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-dd9fc6a1-dde6-4800-b93b-28e0240ac6f9 req-117623f8-933c-4007-86d8-cef8635af7e1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031937 May 16 20:47:11.848125 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 488/974] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:47:12.359110 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-868fd31a-f951-43c2-afcb-c8722e406251 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:12.359768 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-868fd31a-f951-43c2-afcb-c8722e406251 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:12.366350 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-868fd31a-f951-43c2-afcb-c8722e406251 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:12.366799 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-868fd31a-f951-43c2-afcb-c8722e406251 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:12.368122 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-868fd31a-f951-43c2-afcb-c8722e406251 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:12.368574 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-868fd31a-f951-43c2-afcb-c8722e406251 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:12.412475 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-e6b3b6da-4d21-4eb2-853a-0851c26c6f2f req-ef44f0c3-5546-4367-8bb1-33d4ac9a5ffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0412e9-a238-47bb-8e08-de4a723b74f1", "name": "network-vif-deleted", "tag": "38516439-bbc9-4e23-9ca0-a93ad3f94ec1"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:47:12.422765 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-e6b3b6da-4d21-4eb2-853a-0851c26c6f2f req-ef44f0c3-5546-4367-8bb1-33d4ac9a5ffb service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:12.423211 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-e6b3b6da-4d21-4eb2-853a-0851c26c6f2f req-ef44f0c3-5546-4367-8bb1-33d4ac9a5ffb service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:12.435584 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-e6b3b6da-4d21-4eb2-853a-0851c26c6f2f req-ef44f0c3-5546-4367-8bb1-33d4ac9a5ffb service nova] Creating event network-vif-deleted:38516439-bbc9-4e23-9ca0-a93ad3f94ec1 for instance 0e0412e9-a238-47bb-8e08-de4a723b74f1 on hv-cinder-77703 May 16 20:47:12.442233 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-e6b3b6da-4d21-4eb2-853a-0851c26c6f2f req-ef44f0c3-5546-4367-8bb1-33d4ac9a5ffb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034744 May 16 20:47:12.443113 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 489/975] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:47:12.510349 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-868fd31a-f951-43c2-afcb-c8722e406251 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:47:12.517783 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-868fd31a-f951-43c2-afcb-c8722e406251 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710" status: 200 len: 1362 microversion: 2.1 time: 0.163836 May 16 20:47:12.518351 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 487/976] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:47:12 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:47:12.806388 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-4b8cfa85-14a7-4ecf-b144-03ec638b6727 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:12.807243 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-4b8cfa85-14a7-4ecf-b144-03ec638b6727 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:12.815025 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4b8cfa85-14a7-4ecf-b144-03ec638b6727 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:12.815476 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4b8cfa85-14a7-4ecf-b144-03ec638b6727 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:12.816513 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4b8cfa85-14a7-4ecf-b144-03ec638b6727 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:12.816956 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-4b8cfa85-14a7-4ecf-b144-03ec638b6727 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:12.886356 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-4b8cfa85-14a7-4ecf-b144-03ec638b6727 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa431ce09e44b85b61af972bbce2ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710ecde5160640149c693e0c2b0b0354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:47:12.894609 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-4b8cfa85-14a7-4ecf-b144-03ec638b6727 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 200 len: 1225 microversion: 2.1 time: 0.092308 May 16 20:47:12.895135 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 490/977] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:47:12 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:47:13.538406 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-c1b1268e-cd67-4648-a555-b61481ee83bb tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:13.539361 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-c1b1268e-cd67-4648-a555-b61481ee83bb tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:13.550299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c1b1268e-cd67-4648-a555-b61481ee83bb tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:13.551135 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c1b1268e-cd67-4648-a555-b61481ee83bb tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:13.552392 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c1b1268e-cd67-4648-a555-b61481ee83bb tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:13.553179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c1b1268e-cd67-4648-a555-b61481ee83bb tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:13.691294 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-c1b1268e-cd67-4648-a555-b61481ee83bb tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:47:13.698769 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-c1b1268e-cd67-4648-a555-b61481ee83bb tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710" status: 200 len: 1549 microversion: 2.1 time: 0.167185 May 16 20:47:13.699337 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 488/978] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:47:13 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710 => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:47:13.715994 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-26e68558-3dc9-4a13-aee5-e770d02eefd4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:13.717262 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-26e68558-3dc9-4a13-aee5-e770d02eefd4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:13.724515 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-26e68558-3dc9-4a13-aee5-e770d02eefd4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:13.725046 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-26e68558-3dc9-4a13-aee5-e770d02eefd4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:13.725899 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-26e68558-3dc9-4a13-aee5-e770d02eefd4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:13.726394 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-26e68558-3dc9-4a13-aee5-e770d02eefd4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:13.807653 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-26e68558-3dc9-4a13-aee5-e770d02eefd4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095271 May 16 20:47:13.808573 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 491/979] 10.222.0.49 () {58 vars in 1274 bytes} [Mon May 16 20:47:13 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:47:13.911449 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-3e03ecde-0a66-4189-ac8a-7057dde0592e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:13.912065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-3e03ecde-0a66-4189-ac8a-7057dde0592e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: 0e0412e9-a238-47bb-8e08-de4a723b74f1] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:13.918611 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3e03ecde-0a66-4189-ac8a-7057dde0592e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:13.919057 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3e03ecde-0a66-4189-ac8a-7057dde0592e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:13.919893 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3e03ecde-0a66-4189-ac8a-7057dde0592e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:13.920362 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3e03ecde-0a66-4189-ac8a-7057dde0592e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:13.935957 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-3e03ecde-0a66-4189-ac8a-7057dde0592e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] HTTP exception thrown: Instance 0e0412e9-a238-47bb-8e08-de4a723b74f1 could not be found. May 16 20:47:13.938029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-3e03ecde-0a66-4189-ac8a-7057dde0592e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Request method failure captured: May 16 20:47:13.938029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 HTTP/1.1 May 16 20:47:13.938029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:47:13.938029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:47:13.938029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:47:13.938029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:47:13.938029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:47:13.938029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:47:13.938029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:47:13.938029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:47:13.938029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrZ5Vc8NXooCBCmkZo1tt1PldAz_yBfVhqkVEQlj9Qe9yg3qoQ_NmEZiM2PJpp5v3dKhyxQqNUbimeMcM8ilnX6R-suhozFP71ObYN3jw-b4qBQALQLxrghC1T2tYosx42QkJ-eoJbqIfSEDBO0UbmHhsldlNHt5ZpSE3_D4WGGf8xY May 16 20:47:13.938029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:47:13.938029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:47:13.938029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:47:13.938029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:47:13.938029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:47:13.938029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:47:13.938029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 710ecde5160640149c693e0c2b0b0354 May 16 20:47:13.938029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-TestVolumeBootPattern-1176723552 May 16 20:47:13.938029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:47:13.938029 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:47:13.939580 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_710ecde5160640149c693e0c2b0b0354"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/710ecde5160640149c693e0c2b0b0354"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/710ecde5160640149c693e0c2b0b0354"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/710ecde5160640149c693e0c2b0b0354"}]}] May 16 20:47:13.939580 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-TestVolumeBootPattern-1176723552 May 16 20:47:13.939580 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 710ecde5160640149c693e0c2b0b0354 May 16 20:47:13.939580 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-TestVolumeBootPattern-1176723552 May 16 20:47:13.939580 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-TestVolumeBootPattern-1176723552-project May 16 20:47:13.939580 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:47:13.939580 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:47:13.939580 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: 6fa431ce09e44b85b61af972bbce2ed4 May 16 20:47:13.939580 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-TestVolumeBootPattern-1176723552-project May 16 20:47:13.939580 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:47:13.939580 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance 0e0412e9-a238-47bb-8e08-de4a723b74f1 could not be found. May 16 20:47:13.939580 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': '0e0412e9-a238-47bb-8e08-de4a723b74f1'} May 16 20:47:13.940510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:47:13.940510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:47:13.940510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:47:13.940510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:47:13.940510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:47:13.940510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:47:13.940510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:47:13.940510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:47:13.940510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:47:13.940510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:47:13.940510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e0412e9-a238-47bb-8e08-de4a723b74f1 could not be found. May 16 20:47:13.940510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:47:13.940510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:47:13.940510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:47:13.940510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:47:13.940510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:47:13.940510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:47:13.940510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:47:13.940510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:47:13.940510 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:47:13.941974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:47:13.941974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:47:13.941974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:47:13.941974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:47:13.941974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:47:13.941974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:47:13.941974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:47:13.941974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e0412e9-a238-47bb-8e08-de4a723b74f1 could not be found. May 16 20:47:13.941974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:47:13.941974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:47:13.941974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:47:13.941974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:47:13.941974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:47:13.941974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:47:13.941974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:47:13.941974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:47:13.941974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e0412e9-a238-47bb-8e08-de4a723b74f1 could not be found. May 16 20:47:13.941974 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:47:13.943297 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-3e03ecde-0a66-4189-ac8a-7057dde0592e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Returning 404 to user: Instance 0e0412e9-a238-47bb-8e08-de4a723b74f1 could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:47:13.943297 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-3e03ecde-0a66-4189-ac8a-7057dde0592e tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1" status: 404 len: 111 microversion: 2.1 time: 0.031974 May 16 20:47:13.947734 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 489/980] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:47:13 2022] GET /compute/v2.1/servers/0e0412e9-a238-47bb-8e08-de4a723b74f1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:47:14.385531 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2d7ddfcd-9d3f-40a4-baa2-ac66f2d6e2b9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:14.386364 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-2d7ddfcd-9d3f-40a4-baa2-ac66f2d6e2b9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:14.393112 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2d7ddfcd-9d3f-40a4-baa2-ac66f2d6e2b9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:14.393652 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2d7ddfcd-9d3f-40a4-baa2-ac66f2d6e2b9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:14.394503 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2d7ddfcd-9d3f-40a4-baa2-ac66f2d6e2b9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:14.395091 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2d7ddfcd-9d3f-40a4-baa2-ac66f2d6e2b9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:14.415433 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-2d7ddfcd-9d3f-40a4-baa2-ac66f2d6e2b9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] HTTP exception thrown: Instance d149cb81-d021-4785-8e2b-8fb70edb0abb could not be found. May 16 20:47:14.417210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2d7ddfcd-9d3f-40a4-baa2-ac66f2d6e2b9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Request method failure captured: May 16 20:47:14.417210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: DELETE /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb HTTP/1.1 May 16 20:47:14.417210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:47:14.417210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:47:14.417210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:47:14.417210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:47:14.417210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:47:14.417210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:47:14.417210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:47:14.417210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:47:14.417210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrZ5Vc8NXooCBCmkZo1tt1PldAz_yBfVhqkVEQlj9Qe9yg3qoQ_NmEZiM2PJpp5v3dKhyxQqNUbimeMcM8ilnX6R-suhozFP71ObYN3jw-b4qBQALQLxrghC1T2tYosx42QkJ-eoJbqIfSEDBO0UbmHhsldlNHt5ZpSE3_D4WGGf8xY May 16 20:47:14.417210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:47:14.417210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:47:14.417210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:47:14.417210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:47:14.417210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:47:14.417210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:47:14.417210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 710ecde5160640149c693e0c2b0b0354 May 16 20:47:14.417210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-TestVolumeBootPattern-1176723552 May 16 20:47:14.417210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:47:14.417210 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:47:14.418867 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_710ecde5160640149c693e0c2b0b0354"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/710ecde5160640149c693e0c2b0b0354"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/710ecde5160640149c693e0c2b0b0354"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/710ecde5160640149c693e0c2b0b0354"}]}] May 16 20:47:14.418867 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-TestVolumeBootPattern-1176723552 May 16 20:47:14.418867 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 710ecde5160640149c693e0c2b0b0354 May 16 20:47:14.418867 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-TestVolumeBootPattern-1176723552 May 16 20:47:14.418867 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-TestVolumeBootPattern-1176723552-project May 16 20:47:14.418867 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:47:14.418867 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:47:14.418867 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: 6fa431ce09e44b85b61af972bbce2ed4 May 16 20:47:14.418867 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-TestVolumeBootPattern-1176723552-project May 16 20:47:14.418867 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: > May 16 20:47:14.418867 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Instance d149cb81-d021-4785-8e2b-8fb70edb0abb could not be found. May 16 20:47:14.418867 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': 'd149cb81-d021-4785-8e2b-8fb70edb0abb'} May 16 20:47:14.419651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:47:14.419651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:47:14.419651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:47:14.419651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:47:14.419651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:47:14.419651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:47:14.419651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:47:14.419651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:47:14.419651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:47:14.419651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:47:14.419651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d149cb81-d021-4785-8e2b-8fb70edb0abb could not be found. May 16 20:47:14.419651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:47:14.419651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:47:14.419651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:47:14.419651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:47:14.419651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:47:14.419651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:47:14.419651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:47:14.419651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:47:14.419651 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:47:14.420922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:47:14.420922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 20:47:14.420922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 20:47:14.420922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 20:47:14.420922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 20:47:14.420922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:47:14.420922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:47:14.420922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:47:14.420922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:47:14.420922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d149cb81-d021-4785-8e2b-8fb70edb0abb could not be found. May 16 20:47:14.420922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:47:14.420922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:47:14.420922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:47:14.420922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:47:14.420922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:47:14.420922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:47:14.420922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:47:14.420922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:47:14.420922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d149cb81-d021-4785-8e2b-8fb70edb0abb could not be found. May 16 20:47:14.420922 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:47:14.422220 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2d7ddfcd-9d3f-40a4-baa2-ac66f2d6e2b9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Returning 404 to user: Instance d149cb81-d021-4785-8e2b-8fb70edb0abb could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:47:14.422220 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-2d7ddfcd-9d3f-40a4-baa2-ac66f2d6e2b9 tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 404 len: 111 microversion: 2.1 time: 0.039087 May 16 20:47:14.422220 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 492/981] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:47:14 2022] DELETE /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:47:14.429695 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-4855ffb8-e5c0-462e-80f6-f22c6e6a979d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:14.430392 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-4855ffb8-e5c0-462e-80f6-f22c6e6a979d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] [instance: d149cb81-d021-4785-8e2b-8fb70edb0abb] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:14.437579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4855ffb8-e5c0-462e-80f6-f22c6e6a979d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:14.438104 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4855ffb8-e5c0-462e-80f6-f22c6e6a979d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:14.438976 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4855ffb8-e5c0-462e-80f6-f22c6e6a979d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:14.439410 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-4855ffb8-e5c0-462e-80f6-f22c6e6a979d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:14.453457 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-4855ffb8-e5c0-462e-80f6-f22c6e6a979d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] HTTP exception thrown: Instance d149cb81-d021-4785-8e2b-8fb70edb0abb could not be found. May 16 20:47:14.455000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-4855ffb8-e5c0-462e-80f6-f22c6e6a979d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Request method failure captured: May 16 20:47:14.455000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb HTTP/1.1 May 16 20:47:14.455000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:47:14.455000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:47:14.455000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:47:14.455000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:47:14.455000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:47:14.455000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:47:14.455000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:47:14.455000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:47:14.455000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigrZ5Vc8NXooCBCmkZo1tt1PldAz_yBfVhqkVEQlj9Qe9yg3qoQ_NmEZiM2PJpp5v3dKhyxQqNUbimeMcM8ilnX6R-suhozFP71ObYN3jw-b4qBQALQLxrghC1T2tYosx42QkJ-eoJbqIfSEDBO0UbmHhsldlNHt5ZpSE3_D4WGGf8xY May 16 20:47:14.455000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:47:14.455000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:47:14.455000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:47:14.455000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:47:14.455000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:47:14.455000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:47:14.455000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 710ecde5160640149c693e0c2b0b0354 May 16 20:47:14.455000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-TestVolumeBootPattern-1176723552 May 16 20:47:14.455000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:47:14.455000 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:47:14.456504 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_710ecde5160640149c693e0c2b0b0354"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/710ecde5160640149c693e0c2b0b0354"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/710ecde5160640149c693e0c2b0b0354"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/710ecde5160640149c693e0c2b0b0354"}]}] May 16 20:47:14.456504 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-TestVolumeBootPattern-1176723552 May 16 20:47:14.456504 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 710ecde5160640149c693e0c2b0b0354 May 16 20:47:14.456504 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-TestVolumeBootPattern-1176723552 May 16 20:47:14.456504 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-TestVolumeBootPattern-1176723552-project May 16 20:47:14.456504 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:47:14.456504 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:47:14.456504 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: 6fa431ce09e44b85b61af972bbce2ed4 May 16 20:47:14.456504 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-TestVolumeBootPattern-1176723552-project May 16 20:47:14.456504 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:47:14.456504 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance d149cb81-d021-4785-8e2b-8fb70edb0abb could not be found. May 16 20:47:14.456504 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': 'd149cb81-d021-4785-8e2b-8fb70edb0abb'} May 16 20:47:14.457299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:47:14.457299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:47:14.457299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:47:14.457299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:47:14.457299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:47:14.457299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:47:14.457299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:47:14.457299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:47:14.457299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:47:14.457299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:47:14.457299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d149cb81-d021-4785-8e2b-8fb70edb0abb could not be found. May 16 20:47:14.457299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:47:14.457299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:47:14.457299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:47:14.457299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:47:14.457299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:47:14.457299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:47:14.457299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:47:14.457299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:47:14.457299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:47:14.458579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:47:14.458579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:47:14.458579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:47:14.458579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:47:14.458579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:47:14.458579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:47:14.458579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:47:14.458579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d149cb81-d021-4785-8e2b-8fb70edb0abb could not be found. May 16 20:47:14.458579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:47:14.458579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:47:14.458579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:47:14.458579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:47:14.458579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:47:14.458579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:47:14.458579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:47:14.458579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:47:14.458579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d149cb81-d021-4785-8e2b-8fb70edb0abb could not be found. May 16 20:47:14.458579 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:47:14.459703 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-4855ffb8-e5c0-462e-80f6-f22c6e6a979d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Returning 404 to user: Instance d149cb81-d021-4785-8e2b-8fb70edb0abb could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:47:14.459703 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-4855ffb8-e5c0-462e-80f6-f22c6e6a979d tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb" status: 404 len: 111 microversion: 2.1 time: 0.030566 May 16 20:47:14.459703 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 490/982] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:47:14 2022] GET /compute/v2.1/servers/d149cb81-d021-4785-8e2b-8fb70edb0abb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:47:15.019552 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-144827c0-b51d-470b-9770-21f1a504c0db req-5a39f63a-94ae-4212-8635-09f977202d58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bab26b8b-0542-432f-80bd-0a4b1c794710", "tag": "1d4eb15e-004d-4aa1-9411-88ac26950424"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:47:15.028143 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-144827c0-b51d-470b-9770-21f1a504c0db req-5a39f63a-94ae-4212-8635-09f977202d58 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:15.028591 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-144827c0-b51d-470b-9770-21f1a504c0db req-5a39f63a-94ae-4212-8635-09f977202d58 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:15.039990 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-144827c0-b51d-470b-9770-21f1a504c0db req-5a39f63a-94ae-4212-8635-09f977202d58 service nova] Creating event network-changed:1d4eb15e-004d-4aa1-9411-88ac26950424 for instance bab26b8b-0542-432f-80bd-0a4b1c794710 on hv-cinder-77703 May 16 20:47:15.045247 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-144827c0-b51d-470b-9770-21f1a504c0db req-5a39f63a-94ae-4212-8635-09f977202d58 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029458 May 16 20:47:15.046017 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 493/983] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:47:15.764805 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-7c5f6b1a-ec8d-4985-be70-9abab6f16aab tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] Calling method '.version_select at 0x7f81b101a310>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:15.788676 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-7c5f6b1a-ec8d-4985-be70-9abab6f16aab tempest-TestVolumeBootPattern-1176723552 tempest-TestVolumeBootPattern-1176723552-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1538528591" status: 202 len: 0 microversion: 2.1 time: 0.035438 May 16 20:47:15.789280 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 491/984] 10.222.0.49 () {58 vars in 1262 bytes} [Mon May 16 20:47:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1538528591 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:47:51.236523 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-fccedd3f-a243-40aa-b6d3-33fe96724bae tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:51.237078 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-fccedd3f-a243-40aa-b6d3-33fe96724bae tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:51.243810 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fccedd3f-a243-40aa-b6d3-33fe96724bae tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:51.244257 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fccedd3f-a243-40aa-b6d3-33fe96724bae tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:51.245072 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fccedd3f-a243-40aa-b6d3-33fe96724bae tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:51.245509 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fccedd3f-a243-40aa-b6d3-33fe96724bae tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:51.269094 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-fccedd3f-a243-40aa-b6d3-33fe96724bae tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/ips" status: 200 len: 147 microversion: 2.1 time: 0.039539 May 16 20:47:51.269633 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 494/985] 10.222.0.49 () {58 vars in 1247 bytes} [Mon May 16 20:47:51 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:47:52.621768 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a50c6749-63d5-4cb0-869b-23f4e8095bfa tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47e7a681-616a-4df2-87ee-c6708959361c"}} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:47:52.622853 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-a50c6749-63d5-4cb0-869b-23f4e8095bfa tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:52.630142 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a50c6749-63d5-4cb0-869b-23f4e8095bfa tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:52.630600 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a50c6749-63d5-4cb0-869b-23f4e8095bfa tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:52.631376 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a50c6749-63d5-4cb0-869b-23f4e8095bfa tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:52.631807 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a50c6749-63d5-4cb0-869b-23f4e8095bfa tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:52.869010 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-a50c6749-63d5-4cb0-869b-23f4e8095bfa tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "POST /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251842 May 16 20:47:52.869631 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 492/986] 10.222.0.49 () {60 vars in 1322 bytes} [Mon May 16 20:47:52 2022] POST /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:47:59.353518 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-1b968d3b-2bd5-4de0-a13c-60ac8b8eda5f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:59.354711 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-1b968d3b-2bd5-4de0-a13c-60ac8b8eda5f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:59.363511 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1b968d3b-2bd5-4de0-a13c-60ac8b8eda5f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:59.364138 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1b968d3b-2bd5-4de0-a13c-60ac8b8eda5f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:59.364934 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1b968d3b-2bd5-4de0-a13c-60ac8b8eda5f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:59.365681 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1b968d3b-2bd5-4de0-a13c-60ac8b8eda5f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:59.399624 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-1b968d3b-2bd5-4de0-a13c-60ac8b8eda5f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050100 May 16 20:47:59.400170 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 495/987] 10.222.0.49 () {58 vars in 1301 bytes} [Mon May 16 20:47:59 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:47:59.411534 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a00cfb97-64cd-480c-afe0-932ee883a8d4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:47:59.412079 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-a00cfb97-64cd-480c-afe0-932ee883a8d4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:47:59.421289 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a00cfb97-64cd-480c-afe0-932ee883a8d4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:59.421938 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a00cfb97-64cd-480c-afe0-932ee883a8d4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:59.423126 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a00cfb97-64cd-480c-afe0-932ee883a8d4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:47:59.423750 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a00cfb97-64cd-480c-afe0-932ee883a8d4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:47:59.453157 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-a00cfb97-64cd-480c-afe0-932ee883a8d4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments/47e7a681-616a-4df2-87ee-c6708959361c" status: 200 len: 194 microversion: 2.1 time: 0.046505 May 16 20:47:59.453725 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 493/988] 10.222.0.49 () {58 vars in 1412 bytes} [Mon May 16 20:47:59 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments/47e7a681-616a-4df2-87ee-c6708959361c => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:48:00.794614 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-fb94068a-25a5-4be5-a819-742ff2b11341 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17145de3-9f33-4a59-909c-d21ebed44062"}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:48:00.795770 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-fb94068a-25a5-4be5-a819-742ff2b11341 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:00.802496 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fb94068a-25a5-4be5-a819-742ff2b11341 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:00.803019 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fb94068a-25a5-4be5-a819-742ff2b11341 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:00.803877 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fb94068a-25a5-4be5-a819-742ff2b11341 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:00.804414 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-fb94068a-25a5-4be5-a819-742ff2b11341 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:01.050880 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-fb94068a-25a5-4be5-a819-742ff2b11341 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "POST /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260126 May 16 20:48:01.051537 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 496/989] 10.222.0.49 () {60 vars in 1322 bytes} [Mon May 16 20:48:00 2022] POST /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:48:01.197545 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-b56bd219-48ba-4150-a7bd-ca9d5733faa8 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:01.198075 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-b56bd219-48ba-4150-a7bd-ca9d5733faa8 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:01.206384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b56bd219-48ba-4150-a7bd-ca9d5733faa8 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:01.206903 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b56bd219-48ba-4150-a7bd-ca9d5733faa8 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:01.207898 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b56bd219-48ba-4150-a7bd-ca9d5733faa8 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:01.208339 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-b56bd219-48ba-4150-a7bd-ca9d5733faa8 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:01.235109 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-b56bd219-48ba-4150-a7bd-ca9d5733faa8 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Going to try to terminate instance {{(pid=123564) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:48:01.322179 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-b56bd219-48ba-4150-a7bd-ca9d5733faa8 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 204 len: 0 microversion: 2.1 time: 0.128659 May 16 20:48:01.323921 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 494/990] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:48:01 2022] DELETE /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 20:48:01.334192 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-5a1e0758-54d8-42f5-a3a8-4257c16a2b7a tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:01.335212 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-5a1e0758-54d8-42f5-a3a8-4257c16a2b7a tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:01.341261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5a1e0758-54d8-42f5-a3a8-4257c16a2b7a tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:01.341717 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5a1e0758-54d8-42f5-a3a8-4257c16a2b7a tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:01.342512 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5a1e0758-54d8-42f5-a3a8-4257c16a2b7a tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:01.342949 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-5a1e0758-54d8-42f5-a3a8-4257c16a2b7a tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:01.394949 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-322cf6bd-ca83-4455-b563-74775af18020 req-96edd33a-4726-4fa4-b2b4-6088c5e48a1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd4c11b0-f517-4783-99ec-8a010cb5dbb8", "tag": "29979fec-638a-4157-bbd7-3f1f941c944e"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:48:01.404021 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-322cf6bd-ca83-4455-b563-74775af18020 req-96edd33a-4726-4fa4-b2b4-6088c5e48a1c service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:01.404497 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-322cf6bd-ca83-4455-b563-74775af18020 req-96edd33a-4726-4fa4-b2b4-6088c5e48a1c service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:01.415963 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-322cf6bd-ca83-4455-b563-74775af18020 req-96edd33a-4726-4fa4-b2b4-6088c5e48a1c service nova] Creating event network-changed:29979fec-638a-4157-bbd7-3f1f941c944e for instance cd4c11b0-f517-4783-99ec-8a010cb5dbb8 on hv-cinder-77703 May 16 20:48:01.421626 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-322cf6bd-ca83-4455-b563-74775af18020 req-96edd33a-4726-4fa4-b2b4-6088c5e48a1c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224992 May 16 20:48:01.422443 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 497/991] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:48:01.477164 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-5a1e0758-54d8-42f5-a3a8-4257c16a2b7a tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:01.484662 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-5a1e0758-54d8-42f5-a3a8-4257c16a2b7a tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1567 microversion: 2.1 time: 0.156396 May 16 20:48:01.494369 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 495/992] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:01 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:48:02.507253 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-dc11e216-bbb0-4374-9618-29b9106540fa tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:02.508354 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-dc11e216-bbb0-4374-9618-29b9106540fa tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:02.519621 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dc11e216-bbb0-4374-9618-29b9106540fa tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:02.520068 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dc11e216-bbb0-4374-9618-29b9106540fa tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:02.520862 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dc11e216-bbb0-4374-9618-29b9106540fa tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:02.521293 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-dc11e216-bbb0-4374-9618-29b9106540fa tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:02.660485 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-dc11e216-bbb0-4374-9618-29b9106540fa tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:02.668162 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-dc11e216-bbb0-4374-9618-29b9106540fa tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1567 microversion: 2.1 time: 0.168133 May 16 20:48:02.668756 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 498/993] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:02 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:48:03.687011 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-dd8e3dd6-f93c-4032-98dd-eb4a364dcccc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:03.687622 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-dd8e3dd6-f93c-4032-98dd-eb4a364dcccc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:03.694577 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dd8e3dd6-f93c-4032-98dd-eb4a364dcccc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:03.695024 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dd8e3dd6-f93c-4032-98dd-eb4a364dcccc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:03.695796 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dd8e3dd6-f93c-4032-98dd-eb4a364dcccc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:03.696232 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-dd8e3dd6-f93c-4032-98dd-eb4a364dcccc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:03.993125 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-dd8e3dd6-f93c-4032-98dd-eb4a364dcccc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:04.001273 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-dd8e3dd6-f93c-4032-98dd-eb4a364dcccc tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1567 microversion: 2.1 time: 0.318634 May 16 20:48:04.001857 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 496/994] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:03 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1567 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:48:04.344175 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-6365aaad-8284-421a-b873-a7c1e312e90f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:04.345288 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-6365aaad-8284-421a-b873-a7c1e312e90f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:04.352978 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6365aaad-8284-421a-b873-a7c1e312e90f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:04.353500 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6365aaad-8284-421a-b873-a7c1e312e90f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:04.354330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6365aaad-8284-421a-b873-a7c1e312e90f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:04.354790 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-6365aaad-8284-421a-b873-a7c1e312e90f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:04.385371 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-6365aaad-8284-421a-b873-a7c1e312e90f tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046043 May 16 20:48:04.386127 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 499/995] 10.222.0.49 () {58 vars in 1301 bytes} [Mon May 16 20:48:04 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:48:04.530746 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-c9904c0b-518d-4160-aae2-e5e213734f6b tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:04.531546 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-c9904c0b-518d-4160-aae2-e5e213734f6b tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:04.538720 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c9904c0b-518d-4160-aae2-e5e213734f6b tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:04.539163 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c9904c0b-518d-4160-aae2-e5e213734f6b tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:04.539926 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c9904c0b-518d-4160-aae2-e5e213734f6b tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:04.540374 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-c9904c0b-518d-4160-aae2-e5e213734f6b tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:04.566479 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-48f81b43-ab83-4705-84fb-23d0734024da req-6ceb1ba0-91c9-4a7d-88dc-8342bb7955bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4c11b0-f517-4783-99ec-8a010cb5dbb8", "name": "network-vif-deleted", "tag": "29979fec-638a-4157-bbd7-3f1f941c944e"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:48:04.571579 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-c9904c0b-518d-4160-aae2-e5e213734f6b tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments/47e7a681-616a-4df2-87ee-c6708959361c" status: 200 len: 194 microversion: 2.1 time: 0.045873 May 16 20:48:04.572171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 500/996] 10.222.0.49 () {58 vars in 1412 bytes} [Mon May 16 20:48:04 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments/47e7a681-616a-4df2-87ee-c6708959361c => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:48:04.575045 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-48f81b43-ab83-4705-84fb-23d0734024da req-6ceb1ba0-91c9-4a7d-88dc-8342bb7955bb service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:04.575484 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-48f81b43-ab83-4705-84fb-23d0734024da req-6ceb1ba0-91c9-4a7d-88dc-8342bb7955bb service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:04.582791 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-d587fb89-e7e6-46a5-964f-a2b49a710c03 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:04.583330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-d587fb89-e7e6-46a5-964f-a2b49a710c03 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:04.586747 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-48f81b43-ab83-4705-84fb-23d0734024da req-6ceb1ba0-91c9-4a7d-88dc-8342bb7955bb service nova] Creating event network-vif-deleted:29979fec-638a-4157-bbd7-3f1f941c944e for instance cd4c11b0-f517-4783-99ec-8a010cb5dbb8 on hv-cinder-77703 May 16 20:48:04.589506 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d587fb89-e7e6-46a5-964f-a2b49a710c03 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:04.590365 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d587fb89-e7e6-46a5-964f-a2b49a710c03 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:04.590785 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d587fb89-e7e6-46a5-964f-a2b49a710c03 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:04.591264 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-d587fb89-e7e6-46a5-964f-a2b49a710c03 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:04.591722 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-48f81b43-ab83-4705-84fb-23d0734024da req-6ceb1ba0-91c9-4a7d-88dc-8342bb7955bb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091084 May 16 20:48:04.592311 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 497/997] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:48:04.669305 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.objects.instance [None req-d587fb89-e7e6-46a5-964f-a2b49a710c03 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lazy-loading 'services' on Instance uuid bab26b8b-0542-432f-80bd-0a4b1c794710 {{(pid=123563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:48:04.743271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-d587fb89-e7e6-46a5-964f-a2b49a710c03 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments/47e7a681-616a-4df2-87ee-c6708959361c" status: 202 len: 0 microversion: 2.1 time: 0.164218 May 16 20:48:04.746866 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 501/998] 10.222.0.49 () {58 vars in 1415 bytes} [Mon May 16 20:48:04 2022] DELETE /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments/47e7a681-616a-4df2-87ee-c6708959361c => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 20:48:05.019146 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-64a6efd7-622e-48e9-b049-eca66b287e5f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:05.019842 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-64a6efd7-622e-48e9-b049-eca66b287e5f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:05.026400 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-64a6efd7-622e-48e9-b049-eca66b287e5f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:05.026808 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-64a6efd7-622e-48e9-b049-eca66b287e5f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:05.027610 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-64a6efd7-622e-48e9-b049-eca66b287e5f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:05.028080 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-64a6efd7-622e-48e9-b049-eca66b287e5f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:05.062494 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-64a6efd7-622e-48e9-b049-eca66b287e5f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:05.063183 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-64a6efd7-622e-48e9-b049-eca66b287e5f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:05.063764 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.objects.instance [None req-64a6efd7-622e-48e9-b049-eca66b287e5f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lazy-loading 'fault' on Instance uuid cd4c11b0-f517-4783-99ec-8a010cb5dbb8 {{(pid=123564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:48:05.118980 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-64a6efd7-622e-48e9-b049-eca66b287e5f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efe317417084146a0ff20116ed48cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb89e1020d944ea08b4294be0ac00cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:05.127352 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-64a6efd7-622e-48e9-b049-eca66b287e5f tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 200 len: 1224 microversion: 2.1 time: 0.112934 May 16 20:48:05.127964 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 498/999] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:05 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 1224 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:48:05.866991 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-498c7c39-c916-4121-81d5-2d24d4cc14ae tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:05.867546 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-498c7c39-c916-4121-81d5-2d24d4cc14ae tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:05.873609 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-498c7c39-c916-4121-81d5-2d24d4cc14ae tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:05.874054 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-498c7c39-c916-4121-81d5-2d24d4cc14ae tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:05.874817 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-498c7c39-c916-4121-81d5-2d24d4cc14ae tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:05.875252 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-498c7c39-c916-4121-81d5-2d24d4cc14ae tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:05.903241 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-498c7c39-c916-4121-81d5-2d24d4cc14ae tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments/17145de3-9f33-4a59-909c-d21ebed44062" status: 200 len: 194 microversion: 2.1 time: 0.041227 May 16 20:48:05.903815 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 502/1000] 10.222.0.49 () {58 vars in 1412 bytes} [Mon May 16 20:48:05 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments/17145de3-9f33-4a59-909c-d21ebed44062 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:48:05.914265 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-084de1c0-bba1-4814-bea6-9b7113fefd76 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:05.914640 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-084de1c0-bba1-4814-bea6-9b7113fefd76 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:05.920642 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-084de1c0-bba1-4814-bea6-9b7113fefd76 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:05.921082 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-084de1c0-bba1-4814-bea6-9b7113fefd76 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:05.922137 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-084de1c0-bba1-4814-bea6-9b7113fefd76 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:05.922753 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-084de1c0-bba1-4814-bea6-9b7113fefd76 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:06.002052 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.objects.instance [None req-084de1c0-bba1-4814-bea6-9b7113fefd76 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lazy-loading 'services' on Instance uuid bab26b8b-0542-432f-80bd-0a4b1c794710 {{(pid=123564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:48:06.075177 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-084de1c0-bba1-4814-bea6-9b7113fefd76 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments/17145de3-9f33-4a59-909c-d21ebed44062" status: 202 len: 0 microversion: 2.1 time: 0.165069 May 16 20:48:06.075820 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 499/1001] 10.222.0.49 () {58 vars in 1415 bytes} [Mon May 16 20:48:05 2022] DELETE /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments/17145de3-9f33-4a59-909c-d21ebed44062 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 20:48:06.144795 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-16caf39f-4c40-460f-a7a5-3adfc5aabf17 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:06.145595 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-16caf39f-4c40-460f-a7a5-3adfc5aabf17 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] [instance: cd4c11b0-f517-4783-99ec-8a010cb5dbb8] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:06.151782 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-16caf39f-4c40-460f-a7a5-3adfc5aabf17 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:06.152235 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-16caf39f-4c40-460f-a7a5-3adfc5aabf17 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:06.153037 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-16caf39f-4c40-460f-a7a5-3adfc5aabf17 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:06.153471 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-16caf39f-4c40-460f-a7a5-3adfc5aabf17 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:06.167832 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-16caf39f-4c40-460f-a7a5-3adfc5aabf17 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] HTTP exception thrown: Instance cd4c11b0-f517-4783-99ec-8a010cb5dbb8 could not be found. May 16 20:48:06.169700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-16caf39f-4c40-460f-a7a5-3adfc5aabf17 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Request method failure captured: May 16 20:48:06.169700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 HTTP/1.1 May 16 20:48:06.169700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:48:06.169700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:48:06.169700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:48:06.169700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:48:06.169700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:48:06.169700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:48:06.169700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:48:06.169700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:48:06.169700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigrd1qa9dmNG8mlW1HisC8WkEfF2QKgVD6P-vhZDUzHUpMMKQS0LTPHz-x7OK5YY3aN2GCtXXo9B1hCxLzgREs1QspKkKn_lmtZ1nsKBSFhSzlZ9d44e1BUD2AcTcKvzZCnrZy32cqRFsdXo_UBteveE6a05g0aMtJnMlmQmhW6pSui0 May 16 20:48:06.169700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:48:06.169700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:48:06.169700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:48:06.169700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:48:06.169700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:48:06.169700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:48:06.169700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: eb89e1020d944ea08b4294be0ac00cbf May 16 20:48:06.169700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-TestShelveInstance-429469211 May 16 20:48:06.169700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:48:06.169700 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:48:06.171470 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eb89e1020d944ea08b4294be0ac00cbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb89e1020d944ea08b4294be0ac00cbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eb89e1020d944ea08b4294be0ac00cbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb89e1020d944ea08b4294be0ac00cbf"}]}] May 16 20:48:06.171470 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-TestShelveInstance-429469211 May 16 20:48:06.171470 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: eb89e1020d944ea08b4294be0ac00cbf May 16 20:48:06.171470 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-TestShelveInstance-429469211 May 16 20:48:06.171470 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-TestShelveInstance-429469211-project May 16 20:48:06.171470 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:48:06.171470 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:48:06.171470 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: 7efe317417084146a0ff20116ed48cbb May 16 20:48:06.171470 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-TestShelveInstance-429469211-project May 16 20:48:06.171470 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: > May 16 20:48:06.171470 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Instance cd4c11b0-f517-4783-99ec-8a010cb5dbb8 could not be found. May 16 20:48:06.171470 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': 'cd4c11b0-f517-4783-99ec-8a010cb5dbb8'} May 16 20:48:06.172617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:48:06.172617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:48:06.172617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:48:06.172617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:48:06.172617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:48:06.172617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:48:06.172617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:48:06.172617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:48:06.172617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:48:06.172617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:48:06.172617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd4c11b0-f517-4783-99ec-8a010cb5dbb8 could not be found. May 16 20:48:06.172617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:48:06.172617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:48:06.172617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:48:06.172617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:48:06.172617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:48:06.172617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:48:06.172617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:48:06.172617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:48:06.172617 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:48:06.174263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:48:06.174263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:48:06.174263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:48:06.174263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:48:06.174263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:48:06.174263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:48:06.174263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:48:06.174263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd4c11b0-f517-4783-99ec-8a010cb5dbb8 could not be found. May 16 20:48:06.174263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:48:06.174263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:48:06.174263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:48:06.174263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:48:06.174263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:48:06.174263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:48:06.174263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:48:06.174263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:48:06.174263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd4c11b0-f517-4783-99ec-8a010cb5dbb8 could not be found. May 16 20:48:06.174263 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:48:06.175958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-16caf39f-4c40-460f-a7a5-3adfc5aabf17 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Returning 404 to user: Instance cd4c11b0-f517-4783-99ec-8a010cb5dbb8 could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:48:06.175958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-16caf39f-4c40-460f-a7a5-3adfc5aabf17 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8" status: 404 len: 111 microversion: 2.1 time: 0.030312 May 16 20:48:06.175958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 503/1002] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:06 2022] GET /compute/v2.1/servers/cd4c11b0-f517-4783-99ec-8a010cb5dbb8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:48:06.349893 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-59336909-3faa-4dee-8acc-157e161d8290 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] Calling method '.version_select at 0x7f81b11c3430>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:06.370172 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-59336909-3faa-4dee-8acc-157e161d8290 tempest-TestShelveInstance-429469211 tempest-TestShelveInstance-429469211-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-532846035" status: 202 len: 0 microversion: 2.1 time: 0.024619 May 16 20:48:06.370812 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 500/1003] 10.222.0.49 () {58 vars in 1250 bytes} [Mon May 16 20:48:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-532846035 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:48:07.234734 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-69952a1a-5cf1-42fd-880b-60a0d5f6882c tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:07.235540 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-69952a1a-5cf1-42fd-880b-60a0d5f6882c tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:07.243306 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-69952a1a-5cf1-42fd-880b-60a0d5f6882c tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:07.243887 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-69952a1a-5cf1-42fd-880b-60a0d5f6882c tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:07.244650 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-69952a1a-5cf1-42fd-880b-60a0d5f6882c tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:07.245058 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-69952a1a-5cf1-42fd-880b-60a0d5f6882c tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:07.277971 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-69952a1a-5cf1-42fd-880b-60a0d5f6882c tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048033 May 16 20:48:07.278532 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 504/1004] 10.222.0.49 () {58 vars in 1301 bytes} [Mon May 16 20:48:07 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 20:48:07.386627 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-1a0535be-f899-421f-ad17-4edffcdabfa9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:07.388512 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-1a0535be-f899-421f-ad17-4edffcdabfa9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:07.396772 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1a0535be-f899-421f-ad17-4edffcdabfa9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:07.397317 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1a0535be-f899-421f-ad17-4edffcdabfa9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:07.398298 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1a0535be-f899-421f-ad17-4edffcdabfa9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:07.398902 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1a0535be-f899-421f-ad17-4edffcdabfa9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:07.432477 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-1a0535be-f899-421f-ad17-4edffcdabfa9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050469 May 16 20:48:07.433014 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 501/1005] 10.222.0.49 () {58 vars in 1301 bytes} [Mon May 16 20:48:07 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 20:48:07.489673 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7965b922-7565-4d61-9cf3-4445bdd57cdf tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:07.490177 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-7965b922-7565-4d61-9cf3-4445bdd57cdf tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:07.496602 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7965b922-7565-4d61-9cf3-4445bdd57cdf tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:07.497055 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7965b922-7565-4d61-9cf3-4445bdd57cdf tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:07.497868 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7965b922-7565-4d61-9cf3-4445bdd57cdf tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:07.498297 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7965b922-7565-4d61-9cf3-4445bdd57cdf tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:07.522788 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-7965b922-7565-4d61-9cf3-4445bdd57cdf tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Going to try to terminate instance {{(pid=123563) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:48:07.606229 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-7965b922-7565-4d61-9cf3-4445bdd57cdf tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710" status: 204 len: 0 microversion: 2.1 time: 0.119801 May 16 20:48:07.607410 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 505/1006] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:48:07 2022] DELETE /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 20:48:07.616733 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-3dc54eb0-37af-4f41-bcc8-f729afd4d397 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:07.617440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-3dc54eb0-37af-4f41-bcc8-f729afd4d397 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:07.624242 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3dc54eb0-37af-4f41-bcc8-f729afd4d397 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:07.624803 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3dc54eb0-37af-4f41-bcc8-f729afd4d397 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:07.625659 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3dc54eb0-37af-4f41-bcc8-f729afd4d397 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:07.626217 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-3dc54eb0-37af-4f41-bcc8-f729afd4d397 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:07.802037 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-3dc54eb0-37af-4f41-bcc8-f729afd4d397 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:07.810085 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-3dc54eb0-37af-4f41-bcc8-f729afd4d397 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710" status: 200 len: 1674 microversion: 2.1 time: 0.197559 May 16 20:48:07.810629 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 502/1007] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:07 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710 => generated 1674 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:48:08.828016 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-517c34a1-9339-4c5c-afaf-d062c6db18b4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:08.829045 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-517c34a1-9339-4c5c-afaf-d062c6db18b4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:08.836661 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-517c34a1-9339-4c5c-afaf-d062c6db18b4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:08.837157 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-517c34a1-9339-4c5c-afaf-d062c6db18b4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:08.837960 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-517c34a1-9339-4c5c-afaf-d062c6db18b4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:08.838399 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-517c34a1-9339-4c5c-afaf-d062c6db18b4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:09.003852 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-517c34a1-9339-4c5c-afaf-d062c6db18b4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:09.012006 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-517c34a1-9339-4c5c-afaf-d062c6db18b4 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710" status: 200 len: 1674 microversion: 2.1 time: 0.188524 May 16 20:48:09.012619 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 506/1008] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:08 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710 => generated 1674 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:48:10.029581 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-20557c64-90de-4985-ae2b-166422248e52 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:10.030232 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-20557c64-90de-4985-ae2b-166422248e52 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:10.036975 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-20557c64-90de-4985-ae2b-166422248e52 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:10.037417 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-20557c64-90de-4985-ae2b-166422248e52 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:10.038190 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-20557c64-90de-4985-ae2b-166422248e52 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:10.038616 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-20557c64-90de-4985-ae2b-166422248e52 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:10.341785 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-20557c64-90de-4985-ae2b-166422248e52 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:10.350075 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-20557c64-90de-4985-ae2b-166422248e52 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710" status: 200 len: 1674 microversion: 2.1 time: 0.324345 May 16 20:48:10.350619 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 503/1009] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:10 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710 => generated 1674 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:48:11.079663 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-479dffbf-83a5-480c-a1b5-5186ba590240 req-1fdfe6a9-a33e-4947-94fc-4c47ad1983c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab26b8b-0542-432f-80bd-0a4b1c794710", "name": "network-vif-deleted", "tag": "1d4eb15e-004d-4aa1-9411-88ac26950424"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:48:11.114118 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-479dffbf-83a5-480c-a1b5-5186ba590240 req-1fdfe6a9-a33e-4947-94fc-4c47ad1983c0 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:11.114118 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-479dffbf-83a5-480c-a1b5-5186ba590240 req-1fdfe6a9-a33e-4947-94fc-4c47ad1983c0 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:11.127436 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-479dffbf-83a5-480c-a1b5-5186ba590240 req-1fdfe6a9-a33e-4947-94fc-4c47ad1983c0 service nova] Creating event network-vif-deleted:1d4eb15e-004d-4aa1-9411-88ac26950424 for instance bab26b8b-0542-432f-80bd-0a4b1c794710 on hv-cinder-77703 May 16 20:48:11.139771 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-479dffbf-83a5-480c-a1b5-5186ba590240 req-1fdfe6a9-a33e-4947-94fc-4c47ad1983c0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065198 May 16 20:48:11.142444 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 507/1010] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:48:11.367452 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-af796b63-343f-4db8-aab9-0eabb2475cd9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:11.368947 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-af796b63-343f-4db8-aab9-0eabb2475cd9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:11.378463 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-af796b63-343f-4db8-aab9-0eabb2475cd9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:11.378936 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-af796b63-343f-4db8-aab9-0eabb2475cd9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:11.379967 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-af796b63-343f-4db8-aab9-0eabb2475cd9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:11.380405 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-af796b63-343f-4db8-aab9-0eabb2475cd9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:11.416617 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-af796b63-343f-4db8-aab9-0eabb2475cd9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:11.417169 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-af796b63-343f-4db8-aab9-0eabb2475cd9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:11.417869 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.objects.instance [None req-af796b63-343f-4db8-aab9-0eabb2475cd9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lazy-loading 'fault' on Instance uuid bab26b8b-0542-432f-80bd-0a4b1c794710 {{(pid=123564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 20:48:11.471661 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-af796b63-343f-4db8-aab9-0eabb2475cd9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e56ccc11ac043af908dbfe3a10c9a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccbb9b8d11b499cb9e84da27dd464e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:11.482920 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-af796b63-343f-4db8-aab9-0eabb2475cd9 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710" status: 200 len: 1327 microversion: 2.1 time: 0.119345 May 16 20:48:11.483819 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 504/1011] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:11 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710 => generated 1327 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:48:12.500820 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-62c6961f-c7cc-4142-ad72-3e4a3be48810 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:12.501534 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-62c6961f-c7cc-4142-ad72-3e4a3be48810 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:12.508243 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-62c6961f-c7cc-4142-ad72-3e4a3be48810 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:12.508732 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-62c6961f-c7cc-4142-ad72-3e4a3be48810 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:12.509516 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-62c6961f-c7cc-4142-ad72-3e4a3be48810 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:12.509956 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-62c6961f-c7cc-4142-ad72-3e4a3be48810 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:12.523745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-62c6961f-c7cc-4142-ad72-3e4a3be48810 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] HTTP exception thrown: Instance bab26b8b-0542-432f-80bd-0a4b1c794710 could not be found. May 16 20:48:12.525439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-62c6961f-c7cc-4142-ad72-3e4a3be48810 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Request method failure captured: May 16 20:48:12.525439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710 HTTP/1.1 May 16 20:48:12.525439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:48:12.525439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:48:12.525439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:48:12.525439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:48:12.525439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:48:12.525439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:48:12.525439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:48:12.525439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:48:12.525439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigreQLklr4DXQi-sF5R2oygn5cPcRQq3IyXejx5isxnYmdM5DA4CSAzE0cJqoNzTPZuoQg9tZ4gnseGVwsuKV9T1Az8MEDxAP-5CLU2rxE2PXhsqm49sRkUlcxxhF5N3I_akRNI8ncdYPZ_QM0QWud66Aid-K7zfnspaS14uOY0Cy4Cg May 16 20:48:12.525439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:48:12.525439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:48:12.525439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:48:12.525439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:48:12.525439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:48:12.525439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:48:12.525439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 1ccbb9b8d11b499cb9e84da27dd464e6 May 16 20:48:12.525439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-AttachVolumeTestJSON-1169807290 May 16 20:48:12.525439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:48:12.525439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:48:12.527130 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1ccbb9b8d11b499cb9e84da27dd464e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ccbb9b8d11b499cb9e84da27dd464e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1ccbb9b8d11b499cb9e84da27dd464e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ccbb9b8d11b499cb9e84da27dd464e6"}]}] May 16 20:48:12.527130 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-AttachVolumeTestJSON-1169807290 May 16 20:48:12.527130 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 1ccbb9b8d11b499cb9e84da27dd464e6 May 16 20:48:12.527130 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1169807290 May 16 20:48:12.527130 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-AttachVolumeTestJSON-1169807290-project May 16 20:48:12.527130 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:48:12.527130 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:48:12.527130 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: 0e56ccc11ac043af908dbfe3a10c9a55 May 16 20:48:12.527130 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-AttachVolumeTestJSON-1169807290-project May 16 20:48:12.527130 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: > May 16 20:48:12.527130 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Instance bab26b8b-0542-432f-80bd-0a4b1c794710 could not be found. May 16 20:48:12.527130 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': 'bab26b8b-0542-432f-80bd-0a4b1c794710'} May 16 20:48:12.528088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:48:12.528088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:48:12.528088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:48:12.528088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:48:12.528088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:48:12.528088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:48:12.528088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:48:12.528088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:48:12.528088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:48:12.528088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:48:12.528088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bab26b8b-0542-432f-80bd-0a4b1c794710 could not be found. May 16 20:48:12.528088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:48:12.528088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:48:12.528088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:48:12.528088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:48:12.528088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:48:12.528088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:48:12.528088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:48:12.528088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:48:12.528088 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:48:12.529722 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:48:12.529722 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:48:12.529722 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:48:12.529722 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:48:12.529722 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:48:12.529722 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:48:12.529722 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:48:12.529722 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bab26b8b-0542-432f-80bd-0a4b1c794710 could not be found. May 16 20:48:12.529722 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:48:12.529722 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:48:12.529722 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:48:12.529722 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:48:12.529722 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:48:12.529722 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:48:12.529722 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:48:12.529722 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:48:12.529722 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bab26b8b-0542-432f-80bd-0a4b1c794710 could not be found. May 16 20:48:12.529722 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:48:12.531192 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-62c6961f-c7cc-4142-ad72-3e4a3be48810 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Returning 404 to user: Instance bab26b8b-0542-432f-80bd-0a4b1c794710 could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:48:12.531192 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-62c6961f-c7cc-4142-ad72-3e4a3be48810 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710" status: 404 len: 111 microversion: 2.1 time: 0.031372 May 16 20:48:12.531192 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 508/1012] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:12 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:48:12.536120 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-8bfc4910-cd67-485e-a994-b36c12526162 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '.version_select at 0x7f81b0eaf280>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:12.553651 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-8bfc4910-cd67-485e-a994-b36c12526162 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1572861697" status: 202 len: 0 microversion: 2.1 time: 0.021642 May 16 20:48:12.554234 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 505/1013] 10.222.0.49 () {58 vars in 1220 bytes} [Mon May 16 20:48:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1572861697 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 20:48:15.813946 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0e439d39-b259-4f95-bedf-6c1165121a4d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:15.814466 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0e439d39-b259-4f95-bedf-6c1165121a4d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:15.821507 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0e439d39-b259-4f95-bedf-6c1165121a4d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:15.821956 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0e439d39-b259-4f95-bedf-6c1165121a4d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:15.822720 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0e439d39-b259-4f95-bedf-6c1165121a4d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:15.823148 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0e439d39-b259-4f95-bedf-6c1165121a4d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:15.837019 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-0e439d39-b259-4f95-bedf-6c1165121a4d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] HTTP exception thrown: Instance bab26b8b-0542-432f-80bd-0a4b1c794710 could not be found. May 16 20:48:15.838565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0e439d39-b259-4f95-bedf-6c1165121a4d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Request method failure captured: May 16 20:48:15.838565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: DELETE /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710 HTTP/1.1 May 16 20:48:15.838565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:48:15.838565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:48:15.838565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:48:15.838565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:48:15.838565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:48:15.838565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:48:15.838565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:48:15.838565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:48:15.838565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigreQLklr4DXQi-sF5R2oygn5cPcRQq3IyXejx5isxnYmdM5DA4CSAzE0cJqoNzTPZuoQg9tZ4gnseGVwsuKV9T1Az8MEDxAP-5CLU2rxE2PXhsqm49sRkUlcxxhF5N3I_akRNI8ncdYPZ_QM0QWud66Aid-K7zfnspaS14uOY0Cy4Cg May 16 20:48:15.838565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:48:15.838565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:48:15.838565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:48:15.838565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:48:15.838565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:48:15.838565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:48:15.838565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 1ccbb9b8d11b499cb9e84da27dd464e6 May 16 20:48:15.838565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-AttachVolumeTestJSON-1169807290 May 16 20:48:15.838565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:48:15.838565 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:48:15.840041 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1ccbb9b8d11b499cb9e84da27dd464e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ccbb9b8d11b499cb9e84da27dd464e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1ccbb9b8d11b499cb9e84da27dd464e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ccbb9b8d11b499cb9e84da27dd464e6"}]}] May 16 20:48:15.840041 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-AttachVolumeTestJSON-1169807290 May 16 20:48:15.840041 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 1ccbb9b8d11b499cb9e84da27dd464e6 May 16 20:48:15.840041 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1169807290 May 16 20:48:15.840041 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-AttachVolumeTestJSON-1169807290-project May 16 20:48:15.840041 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:48:15.840041 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:48:15.840041 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: 0e56ccc11ac043af908dbfe3a10c9a55 May 16 20:48:15.840041 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-AttachVolumeTestJSON-1169807290-project May 16 20:48:15.840041 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: > May 16 20:48:15.840041 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Instance bab26b8b-0542-432f-80bd-0a4b1c794710 could not be found. May 16 20:48:15.840041 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': 'bab26b8b-0542-432f-80bd-0a4b1c794710'} May 16 20:48:15.841034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:48:15.841034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:48:15.841034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:48:15.841034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:48:15.841034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:48:15.841034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:48:15.841034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:48:15.841034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:48:15.841034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:48:15.841034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:48:15.841034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bab26b8b-0542-432f-80bd-0a4b1c794710 could not be found. May 16 20:48:15.841034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:48:15.841034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:48:15.841034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:48:15.841034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:48:15.841034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:48:15.841034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:48:15.841034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:48:15.841034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:48:15.841034 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:48:15.842745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:48:15.842745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 20:48:15.842745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 20:48:15.842745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 20:48:15.842745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 20:48:15.842745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:48:15.842745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:48:15.842745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:48:15.842745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:48:15.842745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bab26b8b-0542-432f-80bd-0a4b1c794710 could not be found. May 16 20:48:15.842745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:48:15.842745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:48:15.842745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:48:15.842745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:48:15.842745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:48:15.842745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:48:15.842745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:48:15.842745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:48:15.842745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bab26b8b-0542-432f-80bd-0a4b1c794710 could not be found. May 16 20:48:15.842745 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:48:15.844573 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0e439d39-b259-4f95-bedf-6c1165121a4d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Returning 404 to user: Instance bab26b8b-0542-432f-80bd-0a4b1c794710 could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:48:15.844573 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0e439d39-b259-4f95-bedf-6c1165121a4d tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710" status: 404 len: 111 microversion: 2.1 time: 0.029878 May 16 20:48:15.844573 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 509/1014] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:48:15 2022] DELETE /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:48:15.848912 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-c8653c17-0170-487e-9754-865c8934e547 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:15.849519 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-c8653c17-0170-487e-9754-865c8934e547 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: bab26b8b-0542-432f-80bd-0a4b1c794710] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:15.856230 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c8653c17-0170-487e-9754-865c8934e547 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:15.856705 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c8653c17-0170-487e-9754-865c8934e547 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:15.857462 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c8653c17-0170-487e-9754-865c8934e547 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:15.857887 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-c8653c17-0170-487e-9754-865c8934e547 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:15.870904 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-c8653c17-0170-487e-9754-865c8934e547 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] HTTP exception thrown: Instance bab26b8b-0542-432f-80bd-0a4b1c794710 could not be found. May 16 20:48:15.872563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-c8653c17-0170-487e-9754-865c8934e547 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Request method failure captured: May 16 20:48:15.872563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710 HTTP/1.1 May 16 20:48:15.872563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:48:15.872563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:48:15.872563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:48:15.872563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:48:15.872563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:48:15.872563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:48:15.872563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:48:15.872563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:48:15.872563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigreQLklr4DXQi-sF5R2oygn5cPcRQq3IyXejx5isxnYmdM5DA4CSAzE0cJqoNzTPZuoQg9tZ4gnseGVwsuKV9T1Az8MEDxAP-5CLU2rxE2PXhsqm49sRkUlcxxhF5N3I_akRNI8ncdYPZ_QM0QWud66Aid-K7zfnspaS14uOY0Cy4Cg May 16 20:48:15.872563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:48:15.872563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:48:15.872563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:48:15.872563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:48:15.872563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:48:15.872563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:48:15.872563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 1ccbb9b8d11b499cb9e84da27dd464e6 May 16 20:48:15.872563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-AttachVolumeTestJSON-1169807290 May 16 20:48:15.872563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:48:15.872563 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:48:15.874247 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1ccbb9b8d11b499cb9e84da27dd464e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ccbb9b8d11b499cb9e84da27dd464e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1ccbb9b8d11b499cb9e84da27dd464e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ccbb9b8d11b499cb9e84da27dd464e6"}]}] May 16 20:48:15.874247 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-AttachVolumeTestJSON-1169807290 May 16 20:48:15.874247 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 1ccbb9b8d11b499cb9e84da27dd464e6 May 16 20:48:15.874247 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1169807290 May 16 20:48:15.874247 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-AttachVolumeTestJSON-1169807290-project May 16 20:48:15.874247 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:48:15.874247 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:48:15.874247 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: 0e56ccc11ac043af908dbfe3a10c9a55 May 16 20:48:15.874247 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-AttachVolumeTestJSON-1169807290-project May 16 20:48:15.874247 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:48:15.874247 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance bab26b8b-0542-432f-80bd-0a4b1c794710 could not be found. May 16 20:48:15.874247 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': 'bab26b8b-0542-432f-80bd-0a4b1c794710'} May 16 20:48:15.875440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:48:15.875440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:48:15.875440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:48:15.875440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:48:15.875440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:48:15.875440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:48:15.875440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:48:15.875440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:48:15.875440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:48:15.875440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:48:15.875440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bab26b8b-0542-432f-80bd-0a4b1c794710 could not be found. May 16 20:48:15.875440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:48:15.875440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:48:15.875440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:48:15.875440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:48:15.875440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:48:15.875440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:48:15.875440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:48:15.875440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:48:15.875440 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:48:15.877098 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:48:15.877098 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:48:15.877098 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:48:15.877098 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:48:15.877098 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:48:15.877098 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:48:15.877098 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:48:15.877098 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bab26b8b-0542-432f-80bd-0a4b1c794710 could not be found. May 16 20:48:15.877098 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:48:15.877098 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:48:15.877098 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:48:15.877098 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:48:15.877098 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:48:15.877098 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:48:15.877098 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:48:15.877098 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:48:15.877098 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bab26b8b-0542-432f-80bd-0a4b1c794710 could not be found. May 16 20:48:15.877098 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:48:15.878398 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-c8653c17-0170-487e-9754-865c8934e547 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Returning 404 to user: Instance bab26b8b-0542-432f-80bd-0a4b1c794710 could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:48:15.878398 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-c8653c17-0170-487e-9754-865c8934e547 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710" status: 404 len: 111 microversion: 2.1 time: 0.029412 May 16 20:48:15.878398 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 506/1015] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:15 2022] GET /compute/v2.1/servers/bab26b8b-0542-432f-80bd-0a4b1c794710 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 20:48:17.018010 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2a410bde-3c20-466b-9466-c714667d96c2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:17.018520 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-2a410bde-3c20-466b-9466-c714667d96c2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:17.025344 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2a410bde-3c20-466b-9466-c714667d96c2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:17.025794 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2a410bde-3c20-466b-9466-c714667d96c2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:17.026569 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2a410bde-3c20-466b-9466-c714667d96c2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:17.027013 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-2a410bde-3c20-466b-9466-c714667d96c2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:17.040804 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.wsgi [None req-2a410bde-3c20-466b-9466-c714667d96c2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] HTTP exception thrown: Instance a733942d-a211-4c45-9fcf-8eab9293e040 could not be found. May 16 20:48:17.042352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2a410bde-3c20-466b-9466-c714667d96c2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Request method failure captured: May 16 20:48:17.042352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: request: DELETE /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 HTTP/1.1 May 16 20:48:17.042352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept: application/json May 16 20:48:17.042352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Accept-Encoding: identity May 16 20:48:17.042352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Connection: close May 16 20:48:17.042352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Length: 0 May 16 20:48:17.042352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Content-Type: application/json May 16 20:48:17.042352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Host: 10.222.0.49 May 16 20:48:17.042352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Openstack-System-Scope: None May 16 20:48:17.042352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: User-Agent: python-urllib3/1.26.9 May 16 20:48:17.042352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Auth-Token: gAAAAABigreQLklr4DXQi-sF5R2oygn5cPcRQq3IyXejx5isxnYmdM5DA4CSAzE0cJqoNzTPZuoQg9tZ4gnseGVwsuKV9T1Az8MEDxAP-5CLU2rxE2PXhsqm49sRkUlcxxhF5N3I_akRNI8ncdYPZ_QM0QWud66Aid-K7zfnspaS14uOY0Cy4Cg May 16 20:48:17.042352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Id: None May 16 20:48:17.042352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Domain-Name: None May 16 20:48:17.042352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Identity-Status: Confirmed May 16 20:48:17.042352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Is-Admin-Project: True May 16 20:48:17.042352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Id: default May 16 20:48:17.042352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Domain-Name: Default May 16 20:48:17.042352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Id: 1ccbb9b8d11b499cb9e84da27dd464e6 May 16 20:48:17.042352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Project-Name: tempest-AttachVolumeTestJSON-1169807290 May 16 20:48:17.042352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Role: reader,member May 16 20:48:17.042352 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Roles: reader,member May 16 20:48:17.043938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1ccbb9b8d11b499cb9e84da27dd464e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ccbb9b8d11b499cb9e84da27dd464e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1ccbb9b8d11b499cb9e84da27dd464e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ccbb9b8d11b499cb9e84da27dd464e6"}]}] May 16 20:48:17.043938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant: tempest-AttachVolumeTestJSON-1169807290 May 16 20:48:17.043938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Id: 1ccbb9b8d11b499cb9e84da27dd464e6 May 16 20:48:17.043938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1169807290 May 16 20:48:17.043938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User: tempest-AttachVolumeTestJSON-1169807290-project May 16 20:48:17.043938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Id: default May 16 20:48:17.043938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Domain-Name: Default May 16 20:48:17.043938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Id: 0e56ccc11ac043af908dbfe3a10c9a55 May 16 20:48:17.043938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: X-User-Name: tempest-AttachVolumeTestJSON-1169807290-project May 16 20:48:17.043938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: method: > May 16 20:48:17.043938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: exception: Instance a733942d-a211-4c45-9fcf-8eab9293e040 could not be found. May 16 20:48:17.043938 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: action_args: {'id': 'a733942d-a211-4c45-9fcf-8eab9293e040'} May 16 20:48:17.045064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:48:17.045064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:48:17.045064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:48:17.045064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:48:17.045064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:48:17.045064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:48:17.045064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:48:17.045064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:48:17.045064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:48:17.045064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:48:17.045064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a733942d-a211-4c45-9fcf-8eab9293e040 could not be found. May 16 20:48:17.045064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:48:17.045064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:48:17.045064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:48:17.045064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:48:17.045064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:48:17.045064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:48:17.045064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:48:17.045064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:48:17.045064 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:48:17.046627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:48:17.046627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 20:48:17.046627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 20:48:17.046627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 20:48:17.046627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 20:48:17.046627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:48:17.046627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:48:17.046627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:48:17.046627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:48:17.046627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a733942d-a211-4c45-9fcf-8eab9293e040 could not be found. May 16 20:48:17.046627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:48:17.046627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:48:17.046627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:48:17.046627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:48:17.046627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:48:17.046627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:48:17.046627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:48:17.046627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:48:17.046627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a733942d-a211-4c45-9fcf-8eab9293e040 could not be found. May 16 20:48:17.046627 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: ERROR nova.api.openstack.wsgi May 16 20:48:17.048216 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-2a410bde-3c20-466b-9466-c714667d96c2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Returning 404 to user: Instance a733942d-a211-4c45-9fcf-8eab9293e040 could not be found. {{(pid=123563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:48:17.048216 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-2a410bde-3c20-466b-9466-c714667d96c2 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 404 len: 111 microversion: 2.1 time: 0.029649 May 16 20:48:17.048216 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 510/1016] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:48:17 2022] DELETE /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:48:17.052094 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-1bcab47a-daa1-49dd-bef9-93e0fd4c7698 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:17.052749 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-1bcab47a-daa1-49dd-bef9-93e0fd4c7698 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] [instance: a733942d-a211-4c45-9fcf-8eab9293e040] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:17.059639 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1bcab47a-daa1-49dd-bef9-93e0fd4c7698 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:17.060095 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1bcab47a-daa1-49dd-bef9-93e0fd4c7698 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:17.060890 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1bcab47a-daa1-49dd-bef9-93e0fd4c7698 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:17.061326 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1bcab47a-daa1-49dd-bef9-93e0fd4c7698 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:17.074890 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-1bcab47a-daa1-49dd-bef9-93e0fd4c7698 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] HTTP exception thrown: Instance a733942d-a211-4c45-9fcf-8eab9293e040 could not be found. May 16 20:48:17.076412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-1bcab47a-daa1-49dd-bef9-93e0fd4c7698 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Request method failure captured: May 16 20:48:17.076412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 HTTP/1.1 May 16 20:48:17.076412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:48:17.076412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:48:17.076412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:48:17.076412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:48:17.076412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:48:17.076412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:48:17.076412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:48:17.076412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:48:17.076412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigreQLklr4DXQi-sF5R2oygn5cPcRQq3IyXejx5isxnYmdM5DA4CSAzE0cJqoNzTPZuoQg9tZ4gnseGVwsuKV9T1Az8MEDxAP-5CLU2rxE2PXhsqm49sRkUlcxxhF5N3I_akRNI8ncdYPZ_QM0QWud66Aid-K7zfnspaS14uOY0Cy4Cg May 16 20:48:17.076412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:48:17.076412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:48:17.076412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:48:17.076412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:48:17.076412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:48:17.076412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:48:17.076412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: 1ccbb9b8d11b499cb9e84da27dd464e6 May 16 20:48:17.076412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-AttachVolumeTestJSON-1169807290 May 16 20:48:17.076412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:48:17.076412 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:48:17.078081 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1ccbb9b8d11b499cb9e84da27dd464e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ccbb9b8d11b499cb9e84da27dd464e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1ccbb9b8d11b499cb9e84da27dd464e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ccbb9b8d11b499cb9e84da27dd464e6"}]}] May 16 20:48:17.078081 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-AttachVolumeTestJSON-1169807290 May 16 20:48:17.078081 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: 1ccbb9b8d11b499cb9e84da27dd464e6 May 16 20:48:17.078081 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1169807290 May 16 20:48:17.078081 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-AttachVolumeTestJSON-1169807290-project May 16 20:48:17.078081 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:48:17.078081 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:48:17.078081 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: 0e56ccc11ac043af908dbfe3a10c9a55 May 16 20:48:17.078081 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-AttachVolumeTestJSON-1169807290-project May 16 20:48:17.078081 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:48:17.078081 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance a733942d-a211-4c45-9fcf-8eab9293e040 could not be found. May 16 20:48:17.078081 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': 'a733942d-a211-4c45-9fcf-8eab9293e040'} May 16 20:48:17.079115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:48:17.079115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:48:17.079115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:48:17.079115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:48:17.079115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:48:17.079115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:48:17.079115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:48:17.079115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:48:17.079115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:48:17.079115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:48:17.079115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a733942d-a211-4c45-9fcf-8eab9293e040 could not be found. May 16 20:48:17.079115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:48:17.079115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:48:17.079115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:48:17.079115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:48:17.079115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:48:17.079115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:48:17.079115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:48:17.079115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:48:17.079115 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:48:17.080702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:48:17.080702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:48:17.080702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:48:17.080702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:48:17.080702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:48:17.080702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:48:17.080702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:48:17.080702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a733942d-a211-4c45-9fcf-8eab9293e040 could not be found. May 16 20:48:17.080702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:48:17.080702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:48:17.080702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:48:17.080702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:48:17.080702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:48:17.080702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:48:17.080702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:48:17.080702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:48:17.080702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a733942d-a211-4c45-9fcf-8eab9293e040 could not be found. May 16 20:48:17.080702 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:48:17.082323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-1bcab47a-daa1-49dd-bef9-93e0fd4c7698 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] Returning 404 to user: Instance a733942d-a211-4c45-9fcf-8eab9293e040 could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:48:17.082323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-1bcab47a-daa1-49dd-bef9-93e0fd4c7698 tempest-AttachVolumeTestJSON-1169807290 tempest-AttachVolumeTestJSON-1169807290-project] 10.222.0.49 "GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040" status: 404 len: 111 microversion: 2.1 time: 0.029638 May 16 20:48:17.082323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 507/1017] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:17 2022] GET /compute/v2.1/servers/a733942d-a211-4c45-9fcf-8eab9293e040 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:48:43.513802 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-f5e3466a-27d5-4bab-9cd5-f17527922016 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2120613911", "imageRef": "f9826e12-1d0c-4a5a-9616-338520403016", "flavorRef": "452", "networks": [{"uuid": "e2a6de71-71d8-4163-bea3-c9f0f9b04c71"}]}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:48:43.567734 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.network.neutron [None req-f5e3466a-27d5-4bab-9cd5-f17527922016 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] validate_networks() for [('e2a6de71-71d8-4163-bea3-c9f0f9b04c71', None, None, None, None, None)] {{(pid=123563) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:48:43.985981 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-f5e3466a-27d5-4bab-9cd5-f17527922016 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Flavor limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:48:43.986406 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-f5e3466a-27d5-4bab-9cd5-f17527922016 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Image limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:48:43.986876 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-f5e3466a-27d5-4bab-9cd5-f17527922016 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Flavor pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:48:43.987282 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-f5e3466a-27d5-4bab-9cd5-f17527922016 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Image pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:48:43.987688 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-f5e3466a-27d5-4bab-9cd5-f17527922016 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:48:43.997321 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f5e3466a-27d5-4bab-9cd5-f17527922016 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:43.997771 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f5e3466a-27d5-4bab-9cd5-f17527922016 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:43.998579 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f5e3466a-27d5-4bab-9cd5-f17527922016 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:43.998991 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-f5e3466a-27d5-4bab-9cd5-f17527922016 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:44.015594 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-f5e3466a-27d5-4bab-9cd5-f17527922016 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Getting quotas for project b034bbaaf0414b5aaf2d0f33c24283e8. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:48:44.019656 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-f5e3466a-27d5-4bab-9cd5-f17527922016 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Getting quotas for user 7d8b9804df834dbaa758e9777e51757d and project b034bbaaf0414b5aaf2d0f33c24283e8. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:48:44.031339 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-f5e3466a-27d5-4bab-9cd5-f17527922016 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Going to run 1 instances... {{(pid=123563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:48:44.033717 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-f5e3466a-27d5-4bab-9cd5-f17527922016 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: 6bfb3163-fdaa-407a-99a7-deff3fd32236] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9826e12-1d0c-4a5a-9616-338520403016',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:48:44.090170 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-f5e3466a-27d5-4bab-9cd5-f17527922016 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580509 May 16 20:48:44.090833 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 511/1018] 10.222.0.49 () {60 vars in 1146 bytes} [Mon May 16 20:48:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 20:48:44.101127 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-4f05adca-95b7-4201-b563-1ced8a573348 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:44.101762 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-4f05adca-95b7-4201-b563-1ced8a573348 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: 6bfb3163-fdaa-407a-99a7-deff3fd32236] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:44.155546 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-4f05adca-95b7-4201-b563-1ced8a573348 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:44.162185 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-4f05adca-95b7-4201-b563-1ced8a573348 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236" status: 200 len: 1214 microversion: 2.1 time: 0.065018 May 16 20:48:44.162736 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 508/1019] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:44 2022] GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:48:45.181929 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-0c500c88-1f62-4182-8d86-bfe45839cd68 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:45.182563 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-0c500c88-1f62-4182-8d86-bfe45839cd68 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: 6bfb3163-fdaa-407a-99a7-deff3fd32236] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:45.189576 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0c500c88-1f62-4182-8d86-bfe45839cd68 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:45.190028 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0c500c88-1f62-4182-8d86-bfe45839cd68 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:45.190816 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0c500c88-1f62-4182-8d86-bfe45839cd68 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:45.191252 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-0c500c88-1f62-4182-8d86-bfe45839cd68 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:45.263831 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-0c500c88-1f62-4182-8d86-bfe45839cd68 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:45.271569 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-0c500c88-1f62-4182-8d86-bfe45839cd68 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236" status: 200 len: 1284 microversion: 2.1 time: 0.095299 May 16 20:48:45.272953 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 512/1020] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:45 2022] GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:48:46.288673 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-1843ddb1-9370-4bdc-b5df-d6ae612af27a tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:46.289526 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-1843ddb1-9370-4bdc-b5df-d6ae612af27a tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: 6bfb3163-fdaa-407a-99a7-deff3fd32236] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:46.296886 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1843ddb1-9370-4bdc-b5df-d6ae612af27a tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:46.297364 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1843ddb1-9370-4bdc-b5df-d6ae612af27a tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:46.298151 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1843ddb1-9370-4bdc-b5df-d6ae612af27a tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:46.298582 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1843ddb1-9370-4bdc-b5df-d6ae612af27a tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:46.503705 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-1843ddb1-9370-4bdc-b5df-d6ae612af27a tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:46.511762 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-1843ddb1-9370-4bdc-b5df-d6ae612af27a tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236" status: 200 len: 1314 microversion: 2.1 time: 0.227201 May 16 20:48:46.512396 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 509/1021] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:46 2022] GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:48:46.788381 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-eb6fab35-e4d8-4e23-9195-de82891c3c57 req-464e5bed-e38b-44b1-b1bd-5bbbc5ee3f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bfb3163-fdaa-407a-99a7-deff3fd32236", "tag": "d28e266f-2b9b-4345-af32-ca169142e720"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:48:46.799785 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-eb6fab35-e4d8-4e23-9195-de82891c3c57 req-464e5bed-e38b-44b1-b1bd-5bbbc5ee3f41 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:46.800588 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-eb6fab35-e4d8-4e23-9195-de82891c3c57 req-464e5bed-e38b-44b1-b1bd-5bbbc5ee3f41 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:46.813704 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-eb6fab35-e4d8-4e23-9195-de82891c3c57 req-464e5bed-e38b-44b1-b1bd-5bbbc5ee3f41 service nova] Creating event network-changed:d28e266f-2b9b-4345-af32-ca169142e720 for instance 6bfb3163-fdaa-407a-99a7-deff3fd32236 on hv-cinder-77703 May 16 20:48:46.821686 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-eb6fab35-e4d8-4e23-9195-de82891c3c57 req-464e5bed-e38b-44b1-b1bd-5bbbc5ee3f41 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037013 May 16 20:48:46.823364 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 513/1022] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:48:47.532912 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-8a8aa7c1-69ac-4f40-85ca-56865632bb95 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:47.533891 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-8a8aa7c1-69ac-4f40-85ca-56865632bb95 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: 6bfb3163-fdaa-407a-99a7-deff3fd32236] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:47.544910 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-8a8aa7c1-69ac-4f40-85ca-56865632bb95 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:47.545660 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-8a8aa7c1-69ac-4f40-85ca-56865632bb95 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:47.546930 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-8a8aa7c1-69ac-4f40-85ca-56865632bb95 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:47.547716 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-8a8aa7c1-69ac-4f40-85ca-56865632bb95 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:47.685842 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-8a8aa7c1-69ac-4f40-85ca-56865632bb95 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:47.693662 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-8a8aa7c1-69ac-4f40-85ca-56865632bb95 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236" status: 200 len: 1314 microversion: 2.1 time: 0.167355 May 16 20:48:47.694226 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 510/1023] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:47 2022] GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:48:48.715964 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-ad62aae9-c2a8-4542-8e3d-265f80f4f200 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:48.717133 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-ad62aae9-c2a8-4542-8e3d-265f80f4f200 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: 6bfb3163-fdaa-407a-99a7-deff3fd32236] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:48.725498 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ad62aae9-c2a8-4542-8e3d-265f80f4f200 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:48.725944 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ad62aae9-c2a8-4542-8e3d-265f80f4f200 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:48.726714 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ad62aae9-c2a8-4542-8e3d-265f80f4f200 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:48.727145 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-ad62aae9-c2a8-4542-8e3d-265f80f4f200 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:48.860823 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-ad62aae9-c2a8-4542-8e3d-265f80f4f200 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:48.868566 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-ad62aae9-c2a8-4542-8e3d-265f80f4f200 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236" status: 200 len: 1314 microversion: 2.1 time: 0.159688 May 16 20:48:48.869130 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 514/1024] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:48 2022] GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:48:49.889431 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-62a3acea-caa5-4011-af3f-7f36023982aa tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:49.890445 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-62a3acea-caa5-4011-af3f-7f36023982aa tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: 6bfb3163-fdaa-407a-99a7-deff3fd32236] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:49.901410 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-62a3acea-caa5-4011-af3f-7f36023982aa tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:49.902184 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-62a3acea-caa5-4011-af3f-7f36023982aa tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:49.903460 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-62a3acea-caa5-4011-af3f-7f36023982aa tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:49.904189 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-62a3acea-caa5-4011-af3f-7f36023982aa tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:50.045405 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-62a3acea-caa5-4011-af3f-7f36023982aa tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:50.056941 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-62a3acea-caa5-4011-af3f-7f36023982aa tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236" status: 200 len: 1314 microversion: 2.1 time: 0.173664 May 16 20:48:50.057703 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 511/1025] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:49 2022] GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:48:51.080694 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-b85c0654-5888-493f-8293-5f4b4d3d5fcf tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:51.081960 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-b85c0654-5888-493f-8293-5f4b4d3d5fcf tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: 6bfb3163-fdaa-407a-99a7-deff3fd32236] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:51.089271 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b85c0654-5888-493f-8293-5f4b4d3d5fcf tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:51.089725 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b85c0654-5888-493f-8293-5f4b4d3d5fcf tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:51.090500 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b85c0654-5888-493f-8293-5f4b4d3d5fcf tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:51.090935 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b85c0654-5888-493f-8293-5f4b4d3d5fcf tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:51.223874 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-b85c0654-5888-493f-8293-5f4b4d3d5fcf tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:51.231409 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-b85c0654-5888-493f-8293-5f4b4d3d5fcf tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236" status: 200 len: 1314 microversion: 2.1 time: 0.157299 May 16 20:48:51.231979 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 515/1026] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:51 2022] GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:48:52.247834 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-540f3f93-03dc-4d12-99b8-e4bf582676a3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:52.248450 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-540f3f93-03dc-4d12-99b8-e4bf582676a3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: 6bfb3163-fdaa-407a-99a7-deff3fd32236] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:52.255538 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-540f3f93-03dc-4d12-99b8-e4bf582676a3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:52.256021 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-540f3f93-03dc-4d12-99b8-e4bf582676a3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:52.256829 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-540f3f93-03dc-4d12-99b8-e4bf582676a3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:52.257619 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-540f3f93-03dc-4d12-99b8-e4bf582676a3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:52.391915 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-540f3f93-03dc-4d12-99b8-e4bf582676a3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:52.399676 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-540f3f93-03dc-4d12-99b8-e4bf582676a3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236" status: 200 len: 1314 microversion: 2.1 time: 0.155915 May 16 20:48:52.400467 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 512/1027] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:52 2022] GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:48:52.444735 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-d5bac827-f9f0-4c22-a893-59f52a4003e6 req-8b792eeb-d7ce-47d3-83a4-67d2f8e4e77d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bfb3163-fdaa-407a-99a7-deff3fd32236", "name": "network-vif-plugged", "status": "completed", "tag": "d28e266f-2b9b-4345-af32-ca169142e720"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:48:52.452569 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-d5bac827-f9f0-4c22-a893-59f52a4003e6 req-8b792eeb-d7ce-47d3-83a4-67d2f8e4e77d service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:52.453016 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-d5bac827-f9f0-4c22-a893-59f52a4003e6 req-8b792eeb-d7ce-47d3-83a4-67d2f8e4e77d service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:52.463773 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-d5bac827-f9f0-4c22-a893-59f52a4003e6 req-8b792eeb-d7ce-47d3-83a4-67d2f8e4e77d service nova] Creating event network-vif-plugged:d28e266f-2b9b-4345-af32-ca169142e720 for instance 6bfb3163-fdaa-407a-99a7-deff3fd32236 on hv-cinder-77703 May 16 20:48:52.468797 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-d5bac827-f9f0-4c22-a893-59f52a4003e6 req-8b792eeb-d7ce-47d3-83a4-67d2f8e4e77d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153223 May 16 20:48:52.469362 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 516/1028] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 20:48:53.420611 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-e7fe1351-8084-443a-9843-ad0435aa474f tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:53.421594 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-e7fe1351-8084-443a-9843-ad0435aa474f tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: 6bfb3163-fdaa-407a-99a7-deff3fd32236] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:53.430470 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e7fe1351-8084-443a-9843-ad0435aa474f tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:53.430914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e7fe1351-8084-443a-9843-ad0435aa474f tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:53.431681 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e7fe1351-8084-443a-9843-ad0435aa474f tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:53.432111 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-e7fe1351-8084-443a-9843-ad0435aa474f tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:53.572973 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-e7fe1351-8084-443a-9843-ad0435aa474f tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:53.580936 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-e7fe1351-8084-443a-9843-ad0435aa474f tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236" status: 200 len: 1314 microversion: 2.1 time: 0.166840 May 16 20:48:53.581511 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 513/1029] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:53 2022] GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:48:54.602261 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-b808361c-fcbd-405f-b871-a41a980d5658 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:54.603135 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-b808361c-fcbd-405f-b871-a41a980d5658 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: 6bfb3163-fdaa-407a-99a7-deff3fd32236] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:54.609907 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b808361c-fcbd-405f-b871-a41a980d5658 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:54.610332 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b808361c-fcbd-405f-b871-a41a980d5658 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:54.611146 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b808361c-fcbd-405f-b871-a41a980d5658 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:54.611580 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-b808361c-fcbd-405f-b871-a41a980d5658 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:54.750655 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-b808361c-fcbd-405f-b871-a41a980d5658 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:54.763382 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-b808361c-fcbd-405f-b871-a41a980d5658 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236" status: 200 len: 1497 microversion: 2.1 time: 0.167466 May 16 20:48:54.764199 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 517/1030] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:54 2022] GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236 => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:48:55.172469 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-1fe705f0-8314-49b2-b96e-431902f61e02 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:55.173009 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-1fe705f0-8314-49b2-b96e-431902f61e02 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: 6bfb3163-fdaa-407a-99a7-deff3fd32236] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:55.182748 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1fe705f0-8314-49b2-b96e-431902f61e02 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:55.183500 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1fe705f0-8314-49b2-b96e-431902f61e02 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:55.184692 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1fe705f0-8314-49b2-b96e-431902f61e02 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:55.185316 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-1fe705f0-8314-49b2-b96e-431902f61e02 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:55.212117 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-1fe705f0-8314-49b2-b96e-431902f61e02 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: 6bfb3163-fdaa-407a-99a7-deff3fd32236] Going to try to terminate instance {{(pid=123564) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:48:55.304148 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-1fe705f0-8314-49b2-b96e-431902f61e02 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236" status: 204 len: 0 microversion: 2.1 time: 0.136132 May 16 20:48:55.304783 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 514/1031] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:48:55 2022] DELETE /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 20:48:55.313587 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-7c023ec6-a825-4687-b3e4-a07f30f306f3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:55.314234 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-7c023ec6-a825-4687-b3e4-a07f30f306f3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: 6bfb3163-fdaa-407a-99a7-deff3fd32236] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:55.320330 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7c023ec6-a825-4687-b3e4-a07f30f306f3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:55.321284 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7c023ec6-a825-4687-b3e4-a07f30f306f3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:55.321568 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7c023ec6-a825-4687-b3e4-a07f30f306f3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:55.321996 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-7c023ec6-a825-4687-b3e4-a07f30f306f3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:55.460236 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-7c023ec6-a825-4687-b3e4-a07f30f306f3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:55.468054 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-7c023ec6-a825-4687-b3e4-a07f30f306f3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236" status: 200 len: 1503 microversion: 2.1 time: 0.158527 May 16 20:48:55.468649 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 518/1032] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:55 2022] GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:48:56.495534 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-05f181af-e71d-46e1-b348-bd6663ab8ea7 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:56.496865 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-05f181af-e71d-46e1-b348-bd6663ab8ea7 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: 6bfb3163-fdaa-407a-99a7-deff3fd32236] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:56.507065 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-05f181af-e71d-46e1-b348-bd6663ab8ea7 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:56.507515 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-05f181af-e71d-46e1-b348-bd6663ab8ea7 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:56.508287 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-05f181af-e71d-46e1-b348-bd6663ab8ea7 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:56.508752 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-05f181af-e71d-46e1-b348-bd6663ab8ea7 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:56.719881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-05f181af-e71d-46e1-b348-bd6663ab8ea7 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:56.727940 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-05f181af-e71d-46e1-b348-bd6663ab8ea7 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236" status: 200 len: 1503 microversion: 2.1 time: 0.239616 May 16 20:48:56.728539 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 515/1033] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:56 2022] GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236 => generated 1503 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:48:57.094778 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-83eb2646-c632-4b2b-84ae-50a2e4751901 req-38660f29-762d-4077-a662-c8c3d77f6743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bfb3163-fdaa-407a-99a7-deff3fd32236", "name": "network-vif-deleted", "tag": "d28e266f-2b9b-4345-af32-ca169142e720"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:48:57.103673 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-83eb2646-c632-4b2b-84ae-50a2e4751901 req-38660f29-762d-4077-a662-c8c3d77f6743 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:57.104187 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-83eb2646-c632-4b2b-84ae-50a2e4751901 req-38660f29-762d-4077-a662-c8c3d77f6743 service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:57.118046 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-83eb2646-c632-4b2b-84ae-50a2e4751901 req-38660f29-762d-4077-a662-c8c3d77f6743 service nova] Creating event network-vif-deleted:d28e266f-2b9b-4345-af32-ca169142e720 for instance 6bfb3163-fdaa-407a-99a7-deff3fd32236 on hv-cinder-77703 May 16 20:48:57.123579 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-83eb2646-c632-4b2b-84ae-50a2e4751901 req-38660f29-762d-4077-a662-c8c3d77f6743 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032504 May 16 20:48:57.124178 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 519/1034] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:48:57.746217 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-d6fd2f15-5b26-470b-a4f3-a022d4b61047 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:57.746833 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-d6fd2f15-5b26-470b-a4f3-a022d4b61047 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: 6bfb3163-fdaa-407a-99a7-deff3fd32236] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:57.753494 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d6fd2f15-5b26-470b-a4f3-a022d4b61047 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:57.753952 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d6fd2f15-5b26-470b-a4f3-a022d4b61047 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:57.754755 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d6fd2f15-5b26-470b-a4f3-a022d4b61047 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:57.755191 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-d6fd2f15-5b26-470b-a4f3-a022d4b61047 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:57.768749 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-d6fd2f15-5b26-470b-a4f3-a022d4b61047 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] HTTP exception thrown: Instance 6bfb3163-fdaa-407a-99a7-deff3fd32236 could not be found. May 16 20:48:57.770384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-d6fd2f15-5b26-470b-a4f3-a022d4b61047 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Request method failure captured: May 16 20:48:57.770384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236 HTTP/1.1 May 16 20:48:57.770384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:48:57.770384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:48:57.770384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:48:57.770384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:48:57.770384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:48:57.770384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:48:57.770384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:48:57.770384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:48:57.770384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigripNxLZov9QqNT_JDDCz_wgm0tasiua-FfwoH_u5V-lbmFdrBb5zAQFRxM_5I0J1LIWqRSmtqvVc5g9PufEPLyj77LQ2x52PzpHkhdga4TYgtC57lVNCQVHWmh3r68LH3kfDSLBpxQx6KU4BMJEdWDlSVb_nOStqPQZJXWGgXVPly0 May 16 20:48:57.770384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:48:57.770384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:48:57.770384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:48:57.770384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:48:57.770384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:48:57.770384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:48:57.770384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: b034bbaaf0414b5aaf2d0f33c24283e8 May 16 20:48:57.770384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-VolumesActionsTest-1401052949 May 16 20:48:57.770384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:48:57.770384 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:48:57.772012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b034bbaaf0414b5aaf2d0f33c24283e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b034bbaaf0414b5aaf2d0f33c24283e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b034bbaaf0414b5aaf2d0f33c24283e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b034bbaaf0414b5aaf2d0f33c24283e8"}]}] May 16 20:48:57.772012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-VolumesActionsTest-1401052949 May 16 20:48:57.772012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: b034bbaaf0414b5aaf2d0f33c24283e8 May 16 20:48:57.772012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-VolumesActionsTest-1401052949 May 16 20:48:57.772012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-VolumesActionsTest-1401052949-project May 16 20:48:57.772012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:48:57.772012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:48:57.772012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: 7d8b9804df834dbaa758e9777e51757d May 16 20:48:57.772012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-VolumesActionsTest-1401052949-project May 16 20:48:57.772012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:48:57.772012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance 6bfb3163-fdaa-407a-99a7-deff3fd32236 could not be found. May 16 20:48:57.772012 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': '6bfb3163-fdaa-407a-99a7-deff3fd32236'} May 16 20:48:57.772919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:48:57.772919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:48:57.772919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:48:57.772919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:48:57.772919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:48:57.772919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:48:57.772919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:48:57.772919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:48:57.772919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:48:57.772919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:48:57.772919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bfb3163-fdaa-407a-99a7-deff3fd32236 could not be found. May 16 20:48:57.772919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:48:57.772919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:48:57.772919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:48:57.772919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:48:57.772919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:48:57.772919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:48:57.772919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:48:57.772919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:48:57.772919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:48:57.774283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:48:57.774283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:48:57.774283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:48:57.774283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:48:57.774283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:48:57.774283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:48:57.774283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:48:57.774283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bfb3163-fdaa-407a-99a7-deff3fd32236 could not be found. May 16 20:48:57.774283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:48:57.774283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:48:57.774283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:48:57.774283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:48:57.774283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:48:57.774283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:48:57.774283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:48:57.774283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:48:57.774283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bfb3163-fdaa-407a-99a7-deff3fd32236 could not be found. May 16 20:48:57.774283 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:48:57.775529 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-d6fd2f15-5b26-470b-a4f3-a022d4b61047 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Returning 404 to user: Instance 6bfb3163-fdaa-407a-99a7-deff3fd32236 could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:48:57.775529 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-d6fd2f15-5b26-470b-a4f3-a022d4b61047 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236" status: 404 len: 111 microversion: 2.1 time: 0.029663 May 16 20:48:57.775529 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 516/1035] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:57 2022] GET /compute/v2.1/servers/6bfb3163-fdaa-407a-99a7-deff3fd32236 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:48:57.827604 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-e74c4baf-bc24-4cf4-a552-17eddf654b93 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-777768792", "imageRef": "f9826e12-1d0c-4a5a-9616-338520403016", "flavorRef": "452", "networks": [{"uuid": "e2a6de71-71d8-4163-bea3-c9f0f9b04c71"}]}} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:48:57.877016 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.network.neutron [None req-e74c4baf-bc24-4cf4-a552-17eddf654b93 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] validate_networks() for [('e2a6de71-71d8-4163-bea3-c9f0f9b04c71', None, None, None, None, None)] {{(pid=123563) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 20:48:58.230023 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-e74c4baf-bc24-4cf4-a552-17eddf654b93 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Flavor limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 20:48:58.230690 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-e74c4baf-bc24-4cf4-a552-17eddf654b93 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Image limits 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 20:48:58.231217 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-e74c4baf-bc24-4cf4-a552-17eddf654b93 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Flavor pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 20:48:58.231790 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-e74c4baf-bc24-4cf4-a552-17eddf654b93 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Image pref 0:0:0 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 20:48:58.232415 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.virt.hardware [None req-e74c4baf-bc24-4cf4-a552-17eddf654b93 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 20:48:58.247060 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e74c4baf-bc24-4cf4-a552-17eddf654b93 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:58.247454 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e74c4baf-bc24-4cf4-a552-17eddf654b93 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:58.248615 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e74c4baf-bc24-4cf4-a552-17eddf654b93 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:58.249189 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-e74c4baf-bc24-4cf4-a552-17eddf654b93 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:58.268611 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-e74c4baf-bc24-4cf4-a552-17eddf654b93 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Getting quotas for project b034bbaaf0414b5aaf2d0f33c24283e8. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 20:48:58.273056 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.quota [None req-e74c4baf-bc24-4cf4-a552-17eddf654b93 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Getting quotas for user 7d8b9804df834dbaa758e9777e51757d and project b034bbaaf0414b5aaf2d0f33c24283e8. Resources: {'cores', 'ram', 'instances'} {{(pid=123563) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 20:48:58.285193 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-e74c4baf-bc24-4cf4-a552-17eddf654b93 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Going to run 1 instances... {{(pid=123563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 20:48:58.287602 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-e74c4baf-bc24-4cf4-a552-17eddf654b93 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: d5f36a6e-ebd7-48a9-bbd3-cad4f207b193] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9826e12-1d0c-4a5a-9616-338520403016',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 20:48:58.339768 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-e74c4baf-bc24-4cf4-a552-17eddf654b93 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516379 May 16 20:48:58.340622 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 520/1036] 10.222.0.49 () {60 vars in 1146 bytes} [Mon May 16 20:48:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 20:48:58.350712 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a8af0b5e-ee0d-4295-834b-811728f62cc8 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:58.351325 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-a8af0b5e-ee0d-4295-834b-811728f62cc8 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: d5f36a6e-ebd7-48a9-bbd3-cad4f207b193] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:58.404037 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-a8af0b5e-ee0d-4295-834b-811728f62cc8 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:58.410662 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-a8af0b5e-ee0d-4295-834b-811728f62cc8 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193" status: 200 len: 1213 microversion: 2.1 time: 0.063948 May 16 20:48:58.411227 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 517/1037] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:58 2022] GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:48:59.427851 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-1fd14fb9-c920-45b6-81da-d909145a0d0c tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:48:59.428473 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-1fd14fb9-c920-45b6-81da-d909145a0d0c tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: d5f36a6e-ebd7-48a9-bbd3-cad4f207b193] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:48:59.435465 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1fd14fb9-c920-45b6-81da-d909145a0d0c tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:59.435969 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1fd14fb9-c920-45b6-81da-d909145a0d0c tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:59.436799 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1fd14fb9-c920-45b6-81da-d909145a0d0c tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:48:59.437244 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-1fd14fb9-c920-45b6-81da-d909145a0d0c tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:48:59.531310 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-1fd14fb9-c920-45b6-81da-d909145a0d0c tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:48:59.540904 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-1fd14fb9-c920-45b6-81da-d909145a0d0c tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193" status: 200 len: 1271 microversion: 2.1 time: 0.117478 May 16 20:48:59.541481 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 521/1038] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:48:59 2022] GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 => generated 1271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:49:00.547985 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [req-e816ba49-1fc1-424f-8c31-c280ffccde9a req-c5e8cdab-a855-452f-8d05-ada3a3a0983b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f36a6e-ebd7-48a9-bbd3-cad4f207b193", "tag": "5f2cfed5-c1b0-4a00-b0bf-cf9093fb6d2e"}]} {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:49:00.557756 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-e816ba49-1fc1-424f-8c31-c280ffccde9a req-c5e8cdab-a855-452f-8d05-ada3a3a0983b service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:00.558881 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [req-e816ba49-1fc1-424f-8c31-c280ffccde9a req-c5e8cdab-a855-452f-8d05-ada3a3a0983b service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:00.560173 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-491283af-85d1-4434-8bae-ad86d393bc37 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:49:00.561878 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-491283af-85d1-4434-8bae-ad86d393bc37 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: d5f36a6e-ebd7-48a9-bbd3-cad4f207b193] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:49:00.569727 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.compute.server_external_events [req-e816ba49-1fc1-424f-8c31-c280ffccde9a req-c5e8cdab-a855-452f-8d05-ada3a3a0983b service nova] Creating event network-changed:5f2cfed5-c1b0-4a00-b0bf-cf9093fb6d2e for instance d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 on hv-cinder-77703 May 16 20:49:00.569965 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-491283af-85d1-4434-8bae-ad86d393bc37 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:00.570619 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-491283af-85d1-4434-8bae-ad86d393bc37 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:00.571581 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-491283af-85d1-4434-8bae-ad86d393bc37 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:00.572232 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-491283af-85d1-4434-8bae-ad86d393bc37 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:00.574513 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [req-e816ba49-1fc1-424f-8c31-c280ffccde9a req-c5e8cdab-a855-452f-8d05-ada3a3a0983b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030233 May 16 20:49:00.575096 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 518/1039] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:49:00.782677 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-491283af-85d1-4434-8bae-ad86d393bc37 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:49:00.790388 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-491283af-85d1-4434-8bae-ad86d393bc37 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193" status: 200 len: 1313 microversion: 2.1 time: 0.236421 May 16 20:49:00.790958 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 522/1040] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:49:00 2022] GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:49:01.810160 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-f68c4983-d8a5-434b-90af-b447ba51f9e3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:49:01.811110 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-f68c4983-d8a5-434b-90af-b447ba51f9e3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: d5f36a6e-ebd7-48a9-bbd3-cad4f207b193] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:49:01.818228 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f68c4983-d8a5-434b-90af-b447ba51f9e3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:01.818919 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f68c4983-d8a5-434b-90af-b447ba51f9e3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:01.819792 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f68c4983-d8a5-434b-90af-b447ba51f9e3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:01.820225 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-f68c4983-d8a5-434b-90af-b447ba51f9e3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:02.028261 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-f68c4983-d8a5-434b-90af-b447ba51f9e3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:49:02.035902 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-f68c4983-d8a5-434b-90af-b447ba51f9e3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193" status: 200 len: 1313 microversion: 2.1 time: 0.232147 May 16 20:49:02.036476 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 519/1041] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:49:01 2022] GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:49:03.058550 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-975ce776-09bd-42ef-a0c9-91d13b896e1e tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:49:03.059188 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-975ce776-09bd-42ef-a0c9-91d13b896e1e tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: d5f36a6e-ebd7-48a9-bbd3-cad4f207b193] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:49:03.065968 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-975ce776-09bd-42ef-a0c9-91d13b896e1e tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:03.066424 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-975ce776-09bd-42ef-a0c9-91d13b896e1e tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:03.067197 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-975ce776-09bd-42ef-a0c9-91d13b896e1e tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:03.067637 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-975ce776-09bd-42ef-a0c9-91d13b896e1e tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:03.212694 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-975ce776-09bd-42ef-a0c9-91d13b896e1e tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:49:03.220807 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-975ce776-09bd-42ef-a0c9-91d13b896e1e tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193" status: 200 len: 1313 microversion: 2.1 time: 0.168308 May 16 20:49:03.221354 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 523/1042] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:49:03 2022] GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:49:04.238067 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-170c3c05-b9ea-4a58-8041-33a30f5b742d tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:49:04.238648 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-170c3c05-b9ea-4a58-8041-33a30f5b742d tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: d5f36a6e-ebd7-48a9-bbd3-cad4f207b193] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:49:04.246118 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-170c3c05-b9ea-4a58-8041-33a30f5b742d tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:04.246571 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-170c3c05-b9ea-4a58-8041-33a30f5b742d tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:04.247401 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-170c3c05-b9ea-4a58-8041-33a30f5b742d tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:04.247914 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-170c3c05-b9ea-4a58-8041-33a30f5b742d tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:04.356691 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-9af01f3b-2f54-4b27-99d0-a1f277be9362 req-6bd4f7b5-67be-4bb7-9b62-0dccfab26b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f36a6e-ebd7-48a9-bbd3-cad4f207b193", "name": "network-vif-plugged", "status": "completed", "tag": "5f2cfed5-c1b0-4a00-b0bf-cf9093fb6d2e"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:49:04.366500 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-9af01f3b-2f54-4b27-99d0-a1f277be9362 req-6bd4f7b5-67be-4bb7-9b62-0dccfab26b9d service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:04.366980 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-9af01f3b-2f54-4b27-99d0-a1f277be9362 req-6bd4f7b5-67be-4bb7-9b62-0dccfab26b9d service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:04.379941 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-170c3c05-b9ea-4a58-8041-33a30f5b742d tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:49:04.386674 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-9af01f3b-2f54-4b27-99d0-a1f277be9362 req-6bd4f7b5-67be-4bb7-9b62-0dccfab26b9d service nova] Creating event network-vif-plugged:5f2cfed5-c1b0-4a00-b0bf-cf9093fb6d2e for instance d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 on hv-cinder-77703 May 16 20:49:04.387530 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-170c3c05-b9ea-4a58-8041-33a30f5b742d tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193" status: 200 len: 1313 microversion: 2.1 time: 0.153355 May 16 20:49:04.388124 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 520/1043] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:49:04 2022] GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:49:04.391917 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-9af01f3b-2f54-4b27-99d0-a1f277be9362 req-6bd4f7b5-67be-4bb7-9b62-0dccfab26b9d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039666 May 16 20:49:04.392770 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 524/1044] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:49:05.405522 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-993af362-7a44-4b8c-b997-7152f28cfdd3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:49:05.406110 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-993af362-7a44-4b8c-b997-7152f28cfdd3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: d5f36a6e-ebd7-48a9-bbd3-cad4f207b193] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:49:05.412916 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-993af362-7a44-4b8c-b997-7152f28cfdd3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:05.413365 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-993af362-7a44-4b8c-b997-7152f28cfdd3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:05.414136 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-993af362-7a44-4b8c-b997-7152f28cfdd3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:05.414577 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-993af362-7a44-4b8c-b997-7152f28cfdd3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:05.548222 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-993af362-7a44-4b8c-b997-7152f28cfdd3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:49:05.556141 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-993af362-7a44-4b8c-b997-7152f28cfdd3 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193" status: 200 len: 1313 microversion: 2.1 time: 0.154604 May 16 20:49:05.556908 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 521/1045] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:49:05 2022] GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:49:06.578402 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-efc1cf50-c5a0-41de-b303-1c7abdf66ada tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:49:06.579616 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-efc1cf50-c5a0-41de-b303-1c7abdf66ada tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: d5f36a6e-ebd7-48a9-bbd3-cad4f207b193] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:49:06.589796 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-efc1cf50-c5a0-41de-b303-1c7abdf66ada tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:06.590240 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-efc1cf50-c5a0-41de-b303-1c7abdf66ada tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:06.591007 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-efc1cf50-c5a0-41de-b303-1c7abdf66ada tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:06.591439 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-efc1cf50-c5a0-41de-b303-1c7abdf66ada tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:06.729481 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-efc1cf50-c5a0-41de-b303-1c7abdf66ada tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:49:06.737787 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-efc1cf50-c5a0-41de-b303-1c7abdf66ada tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193" status: 200 len: 1496 microversion: 2.1 time: 0.166714 May 16 20:49:06.738353 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 525/1046] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:49:06 2022] GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 => generated 1496 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:49:07.185750 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-750f6884-03a9-4e1f-9372-e62362141c37 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:49:07.186468 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-750f6884-03a9-4e1f-9372-e62362141c37 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: d5f36a6e-ebd7-48a9-bbd3-cad4f207b193] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:49:07.197061 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-750f6884-03a9-4e1f-9372-e62362141c37 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:07.197726 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-750f6884-03a9-4e1f-9372-e62362141c37 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:07.198689 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-750f6884-03a9-4e1f-9372-e62362141c37 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:07.199123 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-750f6884-03a9-4e1f-9372-e62362141c37 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:07.226594 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-750f6884-03a9-4e1f-9372-e62362141c37 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: d5f36a6e-ebd7-48a9-bbd3-cad4f207b193] Going to try to terminate instance {{(pid=123564) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 20:49:07.306260 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-750f6884-03a9-4e1f-9372-e62362141c37 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193" status: 204 len: 0 microversion: 2.1 time: 0.126629 May 16 20:49:07.306921 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 522/1047] 10.222.0.49 () {58 vars in 1238 bytes} [Mon May 16 20:49:07 2022] DELETE /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 20:49:07.315535 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [None req-31770704-01ca-4bfd-a721-f945ea1b037e tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:49:07.316153 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.compute.api [None req-31770704-01ca-4bfd-a721-f945ea1b037e tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: d5f36a6e-ebd7-48a9-bbd3-cad4f207b193] Fetching instance by UUID {{(pid=123563) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:49:07.322401 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-31770704-01ca-4bfd-a721-f945ea1b037e tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:07.322966 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-31770704-01ca-4bfd-a721-f945ea1b037e tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:07.323738 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-31770704-01ca-4bfd-a721-f945ea1b037e tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:07.324172 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [None req-31770704-01ca-4bfd-a721-f945ea1b037e tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:07.459171 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.policy [None req-31770704-01ca-4bfd-a721-f945ea1b037e tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123563) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:49:07.470499 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [None req-31770704-01ca-4bfd-a721-f945ea1b037e tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193" status: 200 len: 1502 microversion: 2.1 time: 0.158601 May 16 20:49:07.471249 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 526/1048] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:49:07 2022] GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:49:08.492478 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-ed46bbee-7ee3-40e3-918a-89a0fa3a4e62 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:49:08.493682 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-ed46bbee-7ee3-40e3-918a-89a0fa3a4e62 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: d5f36a6e-ebd7-48a9-bbd3-cad4f207b193] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:49:08.501487 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ed46bbee-7ee3-40e3-918a-89a0fa3a4e62 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:08.501942 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ed46bbee-7ee3-40e3-918a-89a0fa3a4e62 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:08.502717 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ed46bbee-7ee3-40e3-918a-89a0fa3a4e62 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:08.503151 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-ed46bbee-7ee3-40e3-918a-89a0fa3a4e62 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:08.698966 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.policy [None req-ed46bbee-7ee3-40e3-918a-89a0fa3a4e62 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8b9804df834dbaa758e9777e51757d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123564) authorize /opt/stack/nova/nova/policy.py:199}} May 16 20:49:08.706778 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-ed46bbee-7ee3-40e3-918a-89a0fa3a4e62 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193" status: 200 len: 1502 microversion: 2.1 time: 0.221497 May 16 20:49:08.707606 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 523/1049] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:49:08 2022] GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 => generated 1502 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 20:49:09.102540 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG nova.api.openstack.wsgi [req-a4e6788d-860b-44dc-999e-a443d6c4abd5 req-21dd03a5-65ad-4a0b-8d6a-d75213420b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f36a6e-ebd7-48a9-bbd3-cad4f207b193", "name": "network-vif-deleted", "tag": "5f2cfed5-c1b0-4a00-b0bf-cf9093fb6d2e"}]} {{(pid=123563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 20:49:09.111112 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-a4e6788d-860b-44dc-999e-a443d6c4abd5 req-21dd03a5-65ad-4a0b-8d6a-d75213420b0d service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:09.111544 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: DEBUG oslo_concurrency.lockutils [req-a4e6788d-860b-44dc-999e-a443d6c4abd5 req-21dd03a5-65ad-4a0b-8d6a-d75213420b0d service nova] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:09.125198 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.compute.server_external_events [req-a4e6788d-860b-44dc-999e-a443d6c4abd5 req-21dd03a5-65ad-4a0b-8d6a-d75213420b0d service nova] Creating event network-vif-deleted:5f2cfed5-c1b0-4a00-b0bf-cf9093fb6d2e for instance d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 on hv-cinder-77703 May 16 20:49:09.129956 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO nova.api.openstack.requestlog [req-a4e6788d-860b-44dc-999e-a443d6c4abd5 req-21dd03a5-65ad-4a0b-8d6a-d75213420b0d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031106 May 16 20:49:09.130523 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: [pid: 123563|app: 0|req: 527/1050] 10.222.0.49 () {64 vars in 1317 bytes} [Mon May 16 20:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 20:49:09.723517 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a5b9ea6d-0584-4c10-807a-3a13d10e78d9 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Calling method '>' {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 20:49:09.724107 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.compute.api [None req-a5b9ea6d-0584-4c10-807a-3a13d10e78d9 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] [instance: d5f36a6e-ebd7-48a9-bbd3-cad4f207b193] Fetching instance by UUID {{(pid=123564) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 20:49:09.731299 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a5b9ea6d-0584-4c10-807a-3a13d10e78d9 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:09.731748 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a5b9ea6d-0584-4c10-807a-3a13d10e78d9 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:09.732558 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a5b9ea6d-0584-4c10-807a-3a13d10e78d9 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 20:49:09.732995 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG oslo_concurrency.lockutils [None req-a5b9ea6d-0584-4c10-807a-3a13d10e78d9 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Lock "1402e959-c99d-408c-abcd-23ab2c728bba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 20:49:09.746669 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.wsgi [None req-a5b9ea6d-0584-4c10-807a-3a13d10e78d9 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] HTTP exception thrown: Instance d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 could not be found. May 16 20:49:09.748323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a5b9ea6d-0584-4c10-807a-3a13d10e78d9 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Request method failure captured: May 16 20:49:09.748323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: request: GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 HTTP/1.1 May 16 20:49:09.748323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept: application/json May 16 20:49:09.748323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Accept-Encoding: identity May 16 20:49:09.748323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Connection: close May 16 20:49:09.748323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Length: 0 May 16 20:49:09.748323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Content-Type: application/json May 16 20:49:09.748323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Host: 10.222.0.49 May 16 20:49:09.748323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Openstack-System-Scope: None May 16 20:49:09.748323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: User-Agent: python-urllib3/1.26.9 May 16 20:49:09.748323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Auth-Token: gAAAAABigripNxLZov9QqNT_JDDCz_wgm0tasiua-FfwoH_u5V-lbmFdrBb5zAQFRxM_5I0J1LIWqRSmtqvVc5g9PufEPLyj77LQ2x52PzpHkhdga4TYgtC57lVNCQVHWmh3r68LH3kfDSLBpxQx6KU4BMJEdWDlSVb_nOStqPQZJXWGgXVPly0 May 16 20:49:09.748323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Id: None May 16 20:49:09.748323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Domain-Name: None May 16 20:49:09.748323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Identity-Status: Confirmed May 16 20:49:09.748323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Is-Admin-Project: True May 16 20:49:09.748323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Id: default May 16 20:49:09.748323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Domain-Name: Default May 16 20:49:09.748323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Id: b034bbaaf0414b5aaf2d0f33c24283e8 May 16 20:49:09.748323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Project-Name: tempest-VolumesActionsTest-1401052949 May 16 20:49:09.748323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Role: reader,member May 16 20:49:09.748323 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Roles: reader,member May 16 20:49:09.750049 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b034bbaaf0414b5aaf2d0f33c24283e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b034bbaaf0414b5aaf2d0f33c24283e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b034bbaaf0414b5aaf2d0f33c24283e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b034bbaaf0414b5aaf2d0f33c24283e8"}]}] May 16 20:49:09.750049 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant: tempest-VolumesActionsTest-1401052949 May 16 20:49:09.750049 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Id: b034bbaaf0414b5aaf2d0f33c24283e8 May 16 20:49:09.750049 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-Tenant-Name: tempest-VolumesActionsTest-1401052949 May 16 20:49:09.750049 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User: tempest-VolumesActionsTest-1401052949-project May 16 20:49:09.750049 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Id: default May 16 20:49:09.750049 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Domain-Name: Default May 16 20:49:09.750049 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Id: 7d8b9804df834dbaa758e9777e51757d May 16 20:49:09.750049 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: X-User-Name: tempest-VolumesActionsTest-1401052949-project May 16 20:49:09.750049 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: method: > May 16 20:49:09.750049 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: exception: Instance d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 could not be found. May 16 20:49:09.750049 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: action_args: {'id': 'd5f36a6e-ebd7-48a9-bbd3-cad4f207b193'} May 16 20:49:09.751033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: {{(pid=123564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 20:49:09.751033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:49:09.751033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 20:49:09.751033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 20:49:09.751033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 20:49:09.751033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 20:49:09.751033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 20:49:09.751033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 20:49:09.751033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 20:49:09.751033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 20:49:09.751033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 could not be found. May 16 20:49:09.751033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:49:09.751033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:49:09.751033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:49:09.751033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:49:09.751033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:49:09.751033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:49:09.751033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 20:49:09.751033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 20:49:09.751033 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 20:49:09.752625 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 20:49:09.752625 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 20:49:09.752625 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 20:49:09.752625 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 20:49:09.752625 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 20:49:09.752625 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 20:49:09.752625 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 20:49:09.752625 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 could not be found. May 16 20:49:09.752625 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:49:09.752625 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 20:49:09.752625 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:49:09.752625 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 20:49:09.752625 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 20:49:09.752625 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 20:49:09.752625 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 20:49:09.752625 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 20:49:09.752625 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 could not be found. May 16 20:49:09.752625 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: ERROR nova.api.openstack.wsgi May 16 20:49:09.753995 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: DEBUG nova.api.openstack.wsgi [None req-a5b9ea6d-0584-4c10-807a-3a13d10e78d9 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] Returning 404 to user: Instance d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 could not be found. {{(pid=123564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 20:49:09.753995 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO nova.api.openstack.requestlog [None req-a5b9ea6d-0584-4c10-807a-3a13d10e78d9 tempest-VolumesActionsTest-1401052949 tempest-VolumesActionsTest-1401052949-project] 10.222.0.49 "GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193" status: 404 len: 111 microversion: 2.1 time: 0.030203 May 16 20:49:09.753995 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: [pid: 123564|app: 0|req: 524/1051] 10.222.0.49 () {58 vars in 1235 bytes} [Mon May 16 20:49:09 2022] GET /compute/v2.1/servers/d5f36a6e-ebd7-48a9-bbd3-cad4f207b193 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 20:51:52.145452 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 20:51:52.146365 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Mon May 16 20:51:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 20:51:56.578670 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 20:51:56.579388 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Mon May 16 20:51:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 20:52:01.986607 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 20:52:01.987449 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Mon May 16 20:52:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 20:52:07.647508 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 20:52:07.648612 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Mon May 16 20:52:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 20:52:14.390959 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 20:52:14.391605 dv-cinder-777031-16-iscsi devstack@n-api.service[123563]: Mon May 16 20:52:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 20:52:39.829647 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 20:52:39.830494 dv-cinder-777031-16-iscsi devstack@n-api.service[123564]: Mon May 16 20:52:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!